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which evalaates the Hatlonal Instltate of Bducatipn 's Research and 
Development Otillzation j(RDO) prograa. Appendix A contains a 
preliainary report on the statistical qaality of the guantitative 
data,, focQslng priaarily on teacher data. Becoai^datiqns for. 
analysis are aade. Appendix B explains, the 'scaling apd 
standardization procedures atilized f^or each key variable the 
study. Appendix C discusses ^he variations in the nuai>6r of cases. due 
to aaltiplQ data sources and the iaplications of tjiis variation for ^ 
analysis procedures. Appendix D contains cppies o£ the instruments 
u^ed in the , study: the consolidated coding form, tire teacher (survey, ^ 
and the principal siirVey. Appendix E lists t)ie products adopted by 
schools in six RDO^ projects. Appendix F sets forth the criteria for , 
judging the quality of problem soljrin^ in the RDO schools. (MLF) 
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1*0 INTRODUCTION 

This' is q preliminary^ report on the statistical quality of the 
quantitative ROU data, focusing primarily on the teacher^data . Recommen- 
dations for analysis are made* * , - 

H j 

2.0 QUALITY PF THE DATA 

» 

Three'lseta of statistical, analyses were performed to help shed 
light Qii the usefulness of teacher data as indicators of schools level effects* 
These are: variance component general liability analyses (explained below); 
school level correlations of 26 variables from CCF, teacher, and principal 
instruments; and a ^r*K '^T step-^v^lse regiessionG that use variables from all 
three instruments as predictors of school level outcccties* The following 
sections discuss my examination of these materials* 

2*1 Geheralizability of School^LeveJL Means * 

^ The purpose of the geneValizgbilit^ analyses was to assess the 

r^ative strengths of school level and teacher level/error as sources of 

-variance^ and to calculate the generalizability of school level means* 

In classical test theory thffre are two sources of variance — the 

testee's "true scorje" and the testing error (assumed orthoginal to the 

true test score)* Generaliz^ility theory (-Cronbach, Gleser, Nanda, and 

Ra^aratnam, 1972). exiends classical test theory to the case of more general 

sources of variance — not limited to two* Estimation of generalizabilities 

IS conducted via different methods of variance componfent^ analysis .(while 

reliabilities usually come from some 'sort of* correlation , or the internal 

consistency — Cronbach's alpha)* One very useful, field of application 

of generaliz^ility theory has been the estimation of class means (Kane 

and Brer^^n, 1977)^ i»e* averages over persons*' . , . - 

In'the current application — estimating the usefulness of teacher 

level scales as indicators of school level effects — there are two sources . 

x * * 

of variance,* the school effect »id the tfeacher effect* The linear model 



is Yj(i) = tj(i) -f%Si + m wher^ Yij is the scale value for the j'th 
teacher in the.i'th sqhool, m is the^ overall mean, Si is the school effect, 
tj(jL) IS the teacher effect, and'the notation j(i) indicates that j is nested 
within 1. The effects Si and tj(i) are assuned to be .zero mean random 
variables with variances (^\ and '(f* t , raspeCtively. Teacher.^level e'rror. 
I.e. the deviation of the teacher response from th^ true^ value for that 
teacher, is confounded with tj(i). The model is quite different from a cne 
way analysis of variance, which would really be an analysis of school level 
means. • In the current application (Pr- and were ^\ estimated for* each of ^ 
18 constructed scales, via the MIVQUEO' method implemented in the VARCOMP pro- 
cedure of the SAS system. _ 

T^cTC sr? t^c ^'^tc-cc^^i^; ct?tist>;cS'thst can be constructed fro"* 
these variances. ' The first xs 

■■■ r 

which. 13 sinply the fraction of the variarx;e of YjCi) attributable to school 
level effects. Qbviously wiH be very low when the effect is perceived 
very differently by different teachers in the same school, or where there 
IS a great deal of response error, and high where teachers teina to agree on 
school level. effects. - 

• ■ The second statistic is the generalizability (here, for all practical 
purposes, sync^omous with reliability) of the school, level aggregates over 
teachers. General iz^^lities are extremel-y important to assist in interpret 
tatiqp of correlational aTSlyses, especially legressions, and to help guide 
analyses to be conducted. The ^generalizability of the mean for schools with 
Nt teacliers per school i3 




In preparing the data we used the average nuniber of teachfirs per school to 
get a ireason^le estimate of the actual average J^<^ over schools. 

Table i di?plays*the statistics that were compjjted. In order to 
interptet tbent^. xt pecessary to detemUne their potential effects on the 
analy8|s. -The three mosl^ problematic influences of imperfect generalizabilit; 
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ANALYSIS OF 18"C0NSTR^TED SCALES 


• 




Variable 


Nufrber of 
Teabhers 


Nuffber of 
Schools 


11- 


J 


PERSIM» 


560 


172 


.136 ■ 


.425 


SCOPET 


456 * 


. 158 


.776 • 


^ -.909 


ORGIMR 


541 


171 . . 


.510 


.767 


TLWSAT" , 


329 


133 


.^237 


.435 


TTRAIN*. 


* 

58C 


177 


^.339 


• ' .627 


• 

TUSEFL . 


580 


y ' 177 


~::292 


.574 


PROOQUAL 


381 


137 


.282 


s522 


' DiriMP 


378 


131 


.410 


.667. 


LOCOEV 


310 


131 

• 


—.143 


.283 


. PUP IMP 


303 


1-2 A 


.291 


.501 


PROBSOL 


288 


12Z 


-.f414 


.625 


T MOOUSR 


433 


148 ■ 

m 


.021 


.060 


T MCDAOM 


• 433 


148 

« 


-.103 


\ .251 


IS AT PS 


430' 


158 . 


•Zoo 

* 




TCHNGOR 


513 


•173 


.246 




TCOLJ.EG 


536. 


175 


:.189 J 


.417 


TT^NSE • 


523 


175 


~.336 


.60^ 


TPRINSUP 


512 


173 • • 




.609 ' 






t 


> 






m 


• 


* 
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are (1) attenuation of correlations,^ (2) attenuation of statistical power 
of hypothesis tests, and (3) biasing' jof regression coefficients.^ 



Attenuation of Correlations 

Suppose the true correlation of vari^les x and y is r(x,y) and 
, that X end y are measured via, scales of generalizabiljity x and y. 
♦ then ' PiCr^ 

The meaning of this equation is that correlations are attenuated, approxi- 
mately by hJx • order to estimate true correlations ^ne. can dissat- 
.teouate by dividing by ^yJiA ^^^^ quantity is known. If these figures 
are known only approximately, then one should simply take this into account 
in intcrprcti-^s the correlations, 

When correlalipns involving (Teacher variables are disattenuated, 
some very large intercorrelations result. ^ For instance, the uncorrected 
correlation matrix of three impact variables is 
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2 • 


3 

* * 
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ORGIHP 
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.60 


.56 


2 


PERSIST 


.60 


1 


.48- , 


3 


PUMMP 


.56 


.48 


1 








> • 





and the corrected matrix is 

/ 



1 

1.04 
.90 



1.04 
1 

1.04 



— .90 \ 

1 



This indicates that, for all practical purposes, the underlying impact 
variables are virtually identical. They might be usefully^combined into ^ 
a composite variable.' 
W Te6j6s 2a and^ 2b show the correlations (attenua^ And disatt enuated) 

* for nine^leacher variables.* Clearly there is an ^ormously fetrong first 

^ factor operating. Analyses and interpretation may be threatened by this. 

• A. close study of the cluster/factor structure is indicated. 
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TABLE 2a 

' CORREU'ATIONS OF NINE* AGGREG^^TED TEACHER VARIABLES 



I 
2 
3 
4 
5 
6 
7 
8 
9 



ORGIHP 

PERSIA 

TSATPS 

TLNKSAf. 

PRODQUAL 

PUPIW 

PROBSOL 

TUSEFL 

DIFIMP 



1 


2 


3 


4 


5 


6 


7 


8 ' 


9 
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* .60 


.49 


.23 


'.52 . 


.56 


.63 


.50 


.34 


.60 




.33 


.i6 


.47 


;.48 


.52, 


.36 ■ 


. .20 


.49 


.33 




.32 




.32 


^ 1 


,45 


;o6 


.23 


.16 


.32 




.18 


.17 ~ 


.14 


.24 


.03 


.52 " 


.47 


.41 ^ 


.18 




.6.4 


.66 


.45 


.15 


.56 




" .32 


.17 


.64 




,.92 


.4r 


.26 

• 


.63 


.5^ 




.14 


.66 


.92 




.49 


'*.?9 


.50 


■ .36 


..45 


.24 


.45 


.41 


.49 




.22 


.34 




.06 


.03 


, .15 


.26 


.39 


.22 





ERIC. 



9 



TABLE 2b 

CORRELATitWs V NIKE TEACHER VARIABLES', DISATTENUATED 



1 - ORGIMP . - ■ 1.04 

2 PERSIMP 1.04 

3 TSATPS .77 .70 

4 TLrJKSAT* . ; .40 .37 

5 PRODQUAL - - .82 • ,99 

6 PUPIM?* .90 1.04 

7 .PROBSOL , .90 1.00 

8 'tUSEFL ' .75 .73 

9 DiFIMP • .47 .37 
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.47- 
















.70 


.37 


.99 


1.04 


1.00 


.73 


.37 
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..63, 
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.10 
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. statistical Power . . . - * 

The power or the statistical hypothesis tesit Ho;r(i(,y) = 0 is 
attenuated as a curvilinear function of true r(x,y) and "{j^yju^ • TaDfle 
3 exhibits the- power of the test as i/>terpolated from tables given by . 
Cohen (1977). His labels "small", "mediqm", and 'Jlarge" ar^ assigned to 
the, true correlations .1, .3, and .5, and we added tbe' label^"very large" 
for.r = 7. 

The<tabl^ shows that in any caq.ei only a small fraction of small 
effects will be detected statistically. With perfect generalizabllity, 
rtehfly all medium or larger effects will be detected. When^ is .5 
or better nearly all large oj.very large effects will be detected But many 
medium effects wiirTje w.ici&cij. ?m*cii \ fbll^^o .2 or less then only 

a fraction of even very large effects 'will be seen. 

Our judgement is that all of the variables in Table 1 are useful 
.wtih the exception of T HOOUSR* The variables T HODADH and LOC DEV are 
marginal. The remaining 15 (of 18) are sufficiently genetalizable if> •*) 
to give rejection of the null hypothesis substantial meaning as evidence 
that the null hypothesis is in fact true. * ' ^ 

To judge actual effects of diminution of statistical power, I examined 
the correlation matrix of 26 selected variables from all three data sources. 
For nine teacher variables, generalizabilities were avaiiable. I plotted 
the fraction of significant correlations that each of the nine had with 
the 26 variables excluding the unit self correlations. The results are 
cyi Figure 1. ^ - , >^ 

From the obvious Relation between J and fractions of significant 
relations I concluded that nearly all true correlations are strong and that 
the observed correlations wei;e attenuated mostly by general izabiUtfiy effects. 

I confirm^ t\)is conclusion by estimating the central tendency of 
the product^y^^ over the set of 9x25 such products involving teacher variables 
I calculated J^/j^^^^^f astonishingly high. It would be unlikely that 
the generalizability ^of the 26-9 = 15 nonteacher variables averages^ less 
than .8. The vast majority of correlations among ,the 26 "true" variables ' 
appear to be statistically and practjLcslly significant. . Average effects must 
be large to very large. ^ 



" ^TABLE 3 • , 

"power of test r=0, n=;00, d=.05 as" a FUNCTIOP^ OF , 



r(xvy) . Small 



Medium 
.J 



Large 
.5 



Very large 
.7 



1, 



.26 
.17 

/ 

.12 \ 
.09 
1 06 
.05 



.92 


".r.oo 

• 

•» 


.67 


^ .96 


.43. 


.80- 


.22 • " 


.42 


* • 

.13 


.26 






.09 


.12* 



1.00 
1.00 
.96 
.67. 
.38 
.17 



. 1 
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figure 1 ^ . • ^ 

Nine Aggregated Teacher Sfealeat Fr^t jort of 
Significant (cb* .05) Correlations with 25 Other Variables- 



Fraction oF Significant Cdr= •05) : 
" • Cofcrelations. 



✓ s 

V 



\ 



DIFIHP 



* 




/ 



'.4 



.5 



.6 



GeneraUzaby'ity^ j^*' 



.8 



, 9 



O .1 Q 

ERIC \ 



14" 



A 88t of stepwise regressions was coriducted in which independent 
variables were classified into three groups: linker, product, and process. 
Cxajnination of the results leads to the/olldwing conclusions: 

(1) The. teacher prdcess variables have little predictive 

power (average .03) ' * 

(2) ' The Principal Product variables have lij^tle predictive 

power (average ^ = .01) " * 

(3) Overall, the CCF variables have most predictive power. 
Only two of .the teacher process variables (T. MOOUSR, T M0OADM> 

were included in the generalizability analyses." They had the ^wo lowest 
generali2*ilities*(.061 ar\d .251, respectively) of any of the 18 Qomputed* 
Frortwthis wp jurfqe that the 'failure of the teacher process variables to 
'predict outcome Is tiue to their low generalizabilities. 

Although tie can't compute generalizabjlities of the CCF or Principal 
variables we judge them (except for Principal Product variables) equal 
or superior to the teacher variables. CCF variables appear, overfill to' 
be the strongest. Thus except for the two groups identified above, the 
, variables appear to be very sound, 'especially for questionnaire derived 
data. • ' ^ ^ 

3.0 INJERPRETATION OF REGRESSIONS * , * * ' . 

It is cleer that (^a) there is considerable Jnulticolinearity among 
the "true" variables that th^ scales estimate ewd (b) the 'gener aXiz&ilities 
are mostly in the A to ^.9 range very^ good but not perfect.^ The result of 
these two facts is that estimates of regerssion boefficients will be badly 
biased^-- nearly always. Interpretation of B's -from nxadels with more than 
two or ,?o regressors will^be nearly iffipobsiblg^. In models with one regressor 
the B estimates can easily be debiased via the Lord-Porter disattenuation. 
H;Lth more regressors the debiasing computations sre complex but possible. 
In any base we need the values *for geheralizabilities v*iich can be 
^ estimated only for the teacher variables. I would recommend the correc^tion,^ 
however, in models using solely teacher variables as regressors. 



5.0 UPDATE ; ^ ^ • . 

' ' \ 

On the basis^of thfi^and sope additional analysis, the Following 

steps were tak^n^o create a /inal data base for analysis. 

First, based, on the recommendfiTtions presented above, , teacher process 

* ■ * 

variables wi^re dropped from the dpta analysis plans. LOCOEV, "which refers 

to the anount of local -development of materials, was considered too critical 

to' drop, although it has marginal generalizability . ^ . . 

Second, a decision was made to proceed with our original intent, 
' • '* 

which was to aggregate*] individuaJ^teacfjer responses to the school level, 
and R^rge them with principal survey data, and- data obtained from the CCF 
(see Chapter 3).* ^ ^ 

Iniro-- tQ ceai'*ti?h tne oxj^i^^6 muiticollinearit> of variable^, 

♦ >w ^ 

jather than creating Yle^ scales within each data file, it wds decided to ^ 
scale across teapher,' principal and COf data. This- process reduces multiqol 
linearity considerably, but d^s not decrease the predictive -^'^wer of our 
data (see Exhibit A-JV.*- * ' . 

Fourth, a decision was made to procee;d with estimations of missing 
data, teased on the fecommSnSBtsion^ of the audit . The procedure used was 
as- follows; ^ \r 

f variables were classir^e^into groups, based on the 
'\ model tha't^Vormed the* basis for our analysis (see. 

. Figurfe 2^2, p* 35). ^ ' ^ 

- • wiVtiin QacK variable' group, regressions were performed 
on eacb^^variable for whidi there was a substantial 
amount missing data. The regressors were limited 
to other variables within the same group., 

• * estimations Vtf the value of the missing nunbers were 
ma^e-u^ing the regression coefficients fi^om eaclj 
• re^r63slon*6quation. The formula "for the ^timation ♦ 

* procedure* was; 



. Exhibit A-1 



TO: Kareni Sheila, Diane ^ 
FROM: Jim * ^ 

RE; Dgta reduction; plugging missing data 



DATE: 11/12/80 ^ 



Before taking off for the conference in Nashville, I 'rampaged through the 
21 outcome ineasure^ we've been working with and reduced them to 10, as 
follows: 



\ 



Old scale names 
ORGIHP^PORGIMP ^COPEtfCC 

PRGINe ©T9,SC0PE5CC 
SCOPE SCOPET SCOPElCC 
PSATPS TSATP.S ' 
PROBSOL PPRBSOL 
PUP IMP ' • 
kWSAT TLNKSAT 
8T28A 



New scale name 

ZORGIMP: org impact^ 

PEPSIMP {no change): persbnal impacts 

/rnj'JINCs incorporation of process 

RGINC: incorportation of adopted pi^pgram 
7SC0PE: scope of implementation 
7SATPS: site satisfaction with p^ process 
7PR0BS0L: site report problem solved 

pupil impacts 



PUPlfP <no change) 

7LNKSAT: site satis/act ibn with linker 



)ed 



BT28A (no change).: 
different 



% teachers saying ROU 



Reductions were accomplished by standardizing i^aw scales and adding them 
then taking the average. Thu8,*if a case were missing one or two of the 
bid scales, it wot^d ^t'ill have a valid value on the^ new scale. New scales 
aire' not affected by differences in range among the raw scales, and distribu* 
tji^onal properties are made more stable. The missing data problem for outcome 
o^asur^s is appreciably reduced, at least in most cases,, with upwards of 30 
cases added for some outcomes. Finally, mult^collinearity variables from the 
same source was reduced. ^^te that if yoh use anwof these new saales, they 
range from abtput •? to -f-y'witb-^ mean of 0 (standfrdized, you know). 

I have run ^^regressigns represented in the charts passed out ^atligr 
this week, but have not tabled t^e results yet. A summary chart df R for 
the stepwise regressions is atta6hed, however, and shows that our predictive 
power is about the same, i.e., a variable like, say, 70RGIHP has average 
R 9 about*the same as those shown for its three constituent' raw scales. 
This Will probably not change when the plugging of independent variables is 
completed; though N*8 will be tetter. 

Although the number of outcocnes is cut In half, we may still want to drop 
a scale or twO, though I can only suggest BT26A. 
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Proportions of Variance in Outcqcne Measures' 
Explained by Sets of Treatment Indioators: 

R^. from Stepwise Regressions , / ' • • 
With Teachec, Priocipal find CCr Data 







CL 




























CL 


f ' 


















0) 


0) 


0) 




cn 








u 


u 


u 


u 


u 


u 


cn 


cn 


cn 






o 








u 






> 


> 


> 


> 


> 




to 


m 


CD 














> 


> 


> 


0) 


0) 


0) 














0) 


0) 


n 


o 


o 


o 




u 




o 


c 


c 




3 














o 




■o 










& 




c 


"8 


o 


■g 


c 










u 


u 


u 


u 








CL 


CL 


CL 




CL 


CL 


•J 


-J 





Impacts on (participating staff 


.05 


.03 


^03 


.31 


.24-^ 


0* 


.01 


.05 


.08 


Impacts on school as organization (T> 


.21 


0 


.08 


.43 


.36 


.03 


.05 


— u — 
.06 


.03 


Impacts on school^ as organization (?) 


.08 


.005 


.20 


.23 


.10 


.01 


.0^ 


.03 


.18 


Revised process incorporation 


.09 


.05 


.18 


.10 


.06 


.01* 


0 


.01 


.20 


Process ineorporation 1 (?) 


.09 


.08 


.11 


.IGL .05 


0 


0 


0 


.12 


Process incorporation (T) 


.08 


0 


.04 


.32 


.02 


.04 


.02 


.01 


*03 


Program incorporation (P) 


.12 


.07 


.07 


.45 


.14 


.01 


.16 


.02 


.02 


Program incorporation (T) 


,20 


.02 


.06 


.26 


.24 


0 


.14 


.06 


.02 


• 

Program incorporation (C) 


.21 


.09 


.04 


.48 


.14 


0 


.10 


.01 


.05 


Impacts on school *as organization fC) 


™29 


.11 


.10 


.59 


.20 


0 ' 


.12 


.05 


.05 


Scope of implementation 12) 


.06 


.02 


.05 


.25 


.09 


.01 


.13 


0 


.06 


Scope of implementation (T) 


.08 


.01 


.02 


.13 


.34 


0 


.28 


.03 


,01 


Scope of implementation (Z) V 


.21 


.05 


.08 


.35 


r29 


Q 


.30 


.10 


.05 


Principal satisfaction witfypr-ocess (?) 


.05 


.03 


.11 


.37 


.08 


.01 


0 


".07 


.39 


Teacher satisfaction process fT) 


. .03 


0 


.02 


.17 


.25 


(f 


.02 


.01 


0 


Principal satisfaction #ith linker (?) ^ 


.09 


0 


.06 


.18 


.11 


.01 


.16 


.12 


.46 


Teacher satisfaction with linker (1) 


.05 


.03 


.05 


.20 




.07 


'.08 


.15 


% teacher^ report RDU very different 


.17 


0 


.08 


.06 


.03 


0. 


.04 


.18 


.05 


Pupil impaf^ts (T) 


.06 


0 


.02 


.30 


.46 


.09 


•.oV 


0 


.01 


Principal feports problem solved (?) 


,34 


.03 


.06 


.30 


.27 


.05 


.09 


.13 


.04 


Teacher reports proBlenf 'solved (1) 


,10 


0 


.04 


.20 


.54 




.06 


0 


.02 



• ♦O means no variables entered 



^ Proportion of Variance in Outcome Measures ' 
Explained by Sets of Treatfnent Indicators: 

2 • ■ 

R from Stepwise Regressions with 
^Standardized Outcomes Combining Teacher, 
^ * . Principal and CCF Data 
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PREDICTOR SET 


• 


• 




CCF Process 


CCF Products 


Teacher Products 


CCF 1 inl< 


Principal Lipk 


OUTCOME 

* * 






* 


^ 




70RGIHP 


.35 


.54 


.30 


Hi) 


.12 


• 

ZPRqiNC 


.30 


.47 


d9 




.01 














7^C0PE ■ 


.17 


.39 * 




. .36 


.01 . . 


ZPftOCINC 


vlO 


• ,28 


.05. 


o» - 


.08 


7SATPS 


.01 ' 


. .31 


.17 


0» 


.10 


7PR0BS0L 


' .15 


.19 


-.47 


.07 


.03 


iMKSAT 


.02. 


.12 


.12 


' .14 


.39 



erJc 



* ^ind ica tes no variables entered the regression. 

^ - ■ ■ 
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RDU Independent (Treatment) Variables 



Linker variables*- * 

P; Linker contact with principal- 
, Linker initiative 

T; Pet* teachers reporting contact with linker ^ 

C:' Linker contact with local action; team 
Level of linker influence 



Product variables— 

P: Principal's report a product was adopted 

Principalis report the program was difficult to implement 

T; Teachers' report a product was adopted 
Need for roodificdtions to product 
Product quality (scale) ^ 
Difficulty of implementation (scale) 
Need for local devi^lopment of materials (scale) [•] 

C: Was product validated 

• Relative, advantage . _ ^ i 

Did program match problem for which it was selected 
Program complexity \ ^ * ^ 
Implementation reversability [ ] ^ 
Extent \)f preimplereentation modifications ' . ^ 
Extent of postimplementation modifications 
Adequacy of guides*^ for implementation [+] 
Difficulty of implementation 



Process variables — 



P; Principal's involvement in PID 

* principal's involvement in Sol. sel* 

Principal's irfvolvement in PFI 

-'Principal's involvement in Implementation, 

T: Teacher participation in modifications to product 

Administrator participation in' modifications lo product 

C: 'LAT involvement in problem solving 
Tpacher, influence 'in problem solving^ 
Principal influence in problem solving 
LAT influence in problem solving 

Level of problem solving effort . ^ 

Quality of problap salving proceas ^ 
Breadth of problem solvi^Pg participation 
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As will be discussed m Appendix C, this .estimation procedure, (which was 
not performed for all variables due to its expense) does "not eliminate 
problems of missing cases diie to lack of con^letef overlap between our various 
data bases (CCF, teacher and principal surv^s^. Thus,, we were left with a 
missing data problem that was reduced, but not -eliminated. 
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APPESDIX B' - 

4 

1,0 COMPUTATION OF OUTCOtC MEASURES 

As the dLsc'ussions of our study of the RDU project presented in tihe 
#• * * ' " 

body*^trf thi5 report suggest, v*e were faced with a large amount of data/ from 

variety oY sources, related to the ROU treatment itself, possible outcomes 

of the^RDU program at the individual 6nd site levels, and the characteristics 

of the school sites thetnselves. In many cases, data on the same dimension 

were available from more than one data^ source^ This was deliberately built 

into the design of the study so as to enable^ us to "triangulate" on measures , 

critical to our analysis. That is, we wished to ensure^^that data from 

principals and teac^icis, for example, or^ frort principals and our own project 

staff visits to participating schools, were strongly correlated, 

We were also faoed with the problem off too much data ahd too. little 

time and resources to Bnalyze each and every relevant itenr in detail. We 

also knew that, some of our measures would be of greater analytic- utility than 

others. Thus, we faced a serious data reduction task. In addition, we knew 

that some data would 'be missing, e.g., we might jiave teachers' assessments of 

som^ variable,' but not' the principal's because ol^non-jesponse to our surveys 

or lack of knowledge on the topic when we conducted face-to- face interviews^ ' 

'at some sites. * ' ' * ' * 

To deal with these problems, we utilized simple scaling and 'standard- 
ization procedures discussed below, for each key variable, in detail. Th^ 
general strategy was to reduce batteries of items m our instruments to 
scales, either through sunming, averaging, or counting aS these seemed 
appropriate. $ince our primary unit of analysis was the school rather than 
the individual staff member participating m the RDU program, we thin deveiop- 
ed school-level measures (m the case of the teacher Purvey data) by such 
techniques ^ averaging .across teachers withm schools or taking the propor- 
tion of^achers ?t each school who gave a certain response. .Thus, a group of 
teachers would be "pooled" to generate a single observation of some aspect 
of thew school's RDO experience. (Note that the data from principals and 
from our ovm staff's consolidated Voding for^— the CCF~were already at the 
schqbr level.) ' % 



Although m fnany cases there were virtually identical items m 
the teacher and principal surveyjs, this was not always the cas^. Nor did the 
CCF data correspond absolut-^ly with the dat^ from principals and teachers 
(aggr^ated to the school level). To deal with such mconsjstenciesr along 
with a certain aiiount of missing data became an Important data management 
task. We also wished, m our analysis and reporting, to address the question 
of the relative importance of jiif ferent variables in, terms of-affectmg site 
outcomes. * . y . 

Our soluiion to this set of data management complexities was to 
standardize |ite level data (including aggregated teacher data) so fchat . 
difference m, say, scale and range, between data sources Addressing the same 
substantive issues were relieved. This procedures alst* enabled us. to make 
direct comparisons of the analytic utility scalps .tapping several dimensions 
m a single ^y/E%y0me analysis, for example, by examining the size of the Betas 
(standardized* regression coefficient©) m any given regression analysis. 
Finally, problems of missing data W&re alleviated by. being able to average 
standardized scales from different data sources dealing with any given site. . 
Thus, if we had principaKand CCF data on organizational impacts (or any ^ 
other combination of data) we were able to take the arithmetic mean of 
available data as^he final site level measure to be included m our analysis. 
This will become clearer as we discuss the qompufation'of specific site level 
, measures m the rest of this Appendix. This was_done only for variables that 
were strongly mtercorrelated (simple correlations significant at .05 of better; . 
Satisfaction With 'the Services of the Linking Agent 

Linking agents performed a varying set of services for their sites. 
To obtain a measure of how satisfied the staff at these sites were with 
these"^ serviced, the surveys of principals and teachers asked respondents to 
indicate how well they felt the Imkej performed at each of the aqtivities 
listed m Figure X-2. Linkers were^rated "poor" (l) to "excellent" (5) on 
each item. 

The respondents' satis^ction score was the arithemetic mean of 
these ratings. This was done for both principals and teachers m each 
school. Teachers' satisfaction scores were then averaged within schools 
•to generate a school level measure of teachers' satisfaction with the linker. 
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Figure X-2 ., ■ 

' ^ ' ^ LINKER ATTRIBUTES OR ACTIVITIES 



a. Ability to explain clearly tbe purposes, and services of the GROUP 

b. Helpfulness in specifyingi analyzing and diagnosing our particular 
problem? or needs 

c. Helpfulness in developing criteria for selecting the solution best 
suited tp our needs " > 

d* Helpfulness m -locating alternative solutions to our problem 

e. Helpfulness m finding the best match between our problem and a solution 

f • Ability to help us understand how the R4D program or materials could be 
used , . ^ : * ^ - * 

g, Helfultiess in adapting the R4D program or materials * to -our* school or 

* school OlStTKt , V 

h, Helfulness in implementing the new program or materials 
1, Assistance in locating acjditional .technical resource persons 

Availability to- us when we need to talk to hira/hep » 
k. Ability to resolve conflicts fairly ' 
1, Skills* as^ an organiser or coordinator 
m. Assistance m evaluating our program 
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Finallyi the schjjfol lev^l teacfjers* linker^ satisfaction measurf^ 
and the principals* linker satisfaction measures were standardized to unit 
vari&nce at^ut a f^ean of^ero. Thenar ithmetic average of these standard;.zed 
^measures constitutes the final site level measure of satisfaction with the 
linker^* services used m the analyses we report./ 

Scope of Product Implementation 

' Mother measure of the impact ROU had on schools used in this report 
IS the "scope of product implementation^" T his measure was generated so as 
to reflect an assessment of the percentage oT the students exposed to the 
adopted program and the amount of time (each^ Wfeek) they ^ent ^sin§ tfcje 
product or materials. Both principals and teichers were askecHta provide 
these . ' ' ^ 

• The scope measure was calculated^cy multiplying the reported percent*- 
age of pupils affected times the average number of minutes per week the ^ 
produc^or mater&ls wete reported to be used. T^cfters' ^ope^ores were 
averaged withm scKpols to generate school level measOres of teachers' scope 
of implemen tation . Our staff also rated the schools we visited on their scope^ 
of product implemP^tion by rating the percentage of^pupils affected and the 

level of product use^ ' ' 

Finally, the pVincipals' scope scotes, the school level teachers' 
scppe scores and, our-^cope ratings were standardized to unit •variance about a 
mean of^zero^ The anthemetuc average of these standardized measures const i- 
tutes the final site level measure of scope of product implementation used m 
our' analyses. * • \ 

^atisfactiQi^With the Prpljiem SolvirW^rocess 

Principal^ and teachers -were also asked to provide ot^erall assessments 
of how they felt about the problem solving^ actjfviti^s they had been through. 
Since* teachers, and pr:^ncipals tended to be involved in the local problem 
solving profcess in ways that vere different both quantitatively and qualita- 
tively, the relevant 'questions tt^ answ^rtd were also different. 

*Principa¥b w^re asketi how satisfied th^y were (1 = not satisfied;' 
5 r very satisfied) vith the.^assistance or support from five individuals 
or^ groups: ' ^ 
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• the, Ideal school team} ^ ' , . 

• ^ • the 'linking ageajti JtL 

• RDU project staff (excludiog *the linker)?'^ 

* • developers of R4D based programs or materials; and ^ ^ * 

• b^her outside organizations or con^ult^ts. . , v 

The principa^s^scores were cajjj^lated by taking the sun of these five 

ratings « ♦ * , 

Teacherd were often nx)re directly involved in carrying out the 
problem solving activities^* To tap their feelings about^-«?Tis experience they 
were asked whether each of a set of activities took the appropriatfe amount of 
tune as opposed to too litt^le or too much tune. These activities included: 

• ic!cr.t;f>ii>g.thG ncc^ :"pcrt3at problems or needs; 

^ establishing ^criteria for selecting ^lutionj ^ , 

• searching for an R40 based program or materials; 

t selection of an R&O based program or materials; and 

• planning for implementation of the RiO based pro ^ » ^ 

The teachers' scores were calculated by counting the nunber of these activi- 
ties which they said took "about the right amount" of time* Teachers' scores 
wer^ then averaged within schools to generate a school level measure of 
teacher satisfaction with the problem solvnjg process, ? . ^ 

Finally,, principals* scores and school level teachers' scores were 
•standardized to unit variance about a mean of rero. The arithmetic average 
of these two standartiired scores at^ea^ site was taken as the. final site 
^eyel measure of satisfaction with the problem solving process for our 
analyses, * 

Extent the Problem Has' Been Solved _ ^ 

The RiO products and materials implembnted^were selected because,. 
iy\ most cases, the local action teaTfelt that these materi*als woul'd at leaSt 
help to alleviate th^ problem their school had chosen to work on. As part of 
the surveys of principals and teachers, respondents were asked ^about the 
extent^ to which the following<fcad occurred (frwn 0 "not at alF to 4 = "to 
•a very great extent"): , ^ 

^1) Has implementatioh of the program or materials helped solve 
• * the most pressing problem in your school? ^ 



2) Has pupil achievenTent improved as a cesult of the use of 
the program or materials? | 

5) Have pupil attitudes or behavior improved as a . result of 
the use of this program or materials? 

For both teachers and principals, .the "problem solved" scores wpre 
calculated by taking the sgra of thp ratings for the three items cited above. 
Teacher responses were then aggregated to produce sc^iool level measure? o^ 
teachera* assessments of the extent to which the problem was solved by taking 
the arithmetic average of* the individuS^ teachers scores within schools. 
Finally, both principals* scores and school level teacher sc<Jres.w^ere standard- 
ized to^nit variance about a.mean of zero, and the arithmetic averagefof 
these two standardized scores was used as the final measure of the extent to 
which the proble^r has sclveu our oTialyses. 

Personal Impacts on Participating Staff 

Oun earliest site visrts reveal^ that the RDU proggcLgm jwas -haCing a 
variety of Effects on participating staff that were not part of the program's 
originally intended outcomes. To make a global assessment of the effects of 
the program on local school staff, respondents to thd teacher survey were asked 
about the extent to which they hnad personally benefitted fronT their school's 
involvement in^the RDU program (O=*'not at all" to 4r"to' a very gre^t extent") 
in the following ways;- 



a. My teaching skills havd improved ^ 

b. Hy leadership skills haVe improved 

c. I haye learned about curriculum development* 

d. I have more self-confidence 

Other school personnel rely on me more^ 

•I f. I have new resources for helping other' staff members ^ 

q. I have learned more about the problem solving process 

h. I have learned more about the availability of R40 
based programs or materials 

i. My Job is more satisfying 

J.- I have been given more responsibility or have been 
promoted. 

Indiviflual teachers' scores were calculated bjf taking the arithmetic mean of 
t^€iAr responses to these ten items. School level measures of program impact 
on ataff were generated by-^ taking thfi mean of the teacher responses within 
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schools* Thefe we^e then standardized to unit variance about a mean of 
zero, and the tesulting scale used as the final school levei measur^f 
progran impacts 'on'^parjLlcipating staff. 

Incorporation of tlie Adopted RM) Product or Materials 

Ohe of the pi;incipal fiilns of the RDU program was to see that R&D 
products were'^adopteo^ to ^?frlve locally defined problems and that these 
products be used on a continuing basis— i.e., ancorporated—sUbsequent 
to implementation. Because of^the importance of Ihxs outcome, it nas measured 
in three diffes^rtt ways: , in the survey of principals, the survey of teachers, 
and in the CCF data. > , 

Building principals were asked whether any steps had already be&n 

takeTr or mie planned e..wjte Ihot the adopte.^ RiD materials would continue 

to be used. in the future. Specifically, principals were asked^to rate 

whether the /ollowing would not *6ccuj^ (1), roay^-tf^r (2), would def^itely 

occur in*the near future (3), or had already occurred (4): 

a.' Ifhe progran or njatenals have been fo'rmally incorporated 
n / into xumculun plans. 

' Jji Htf have developed written guidelines for the use of the 
* materials ^nd methods from the program* 

\ \b. New staff will receive training or orientation in the 
I use oT the. R&D'program, materials or methods. 

■d. /We will continue to have training programs or inservice 
for curi;^nt staff inembers to maintain'the use of the 
. ^prografDr materials or methods. 

*e. He have purchased -new materials and supplies in order 
to maintain our use of the program or materials* 

f. Because of the use of the program or materials written 
. jojj descriptions foe some staff members have been 
changed. . ^ . 

g';:,He have hired new staff members spepifically to support 
. ' the use' of the R40 program or^ materials. 

h* Our budget now includes a'separate liry* item to support 
^. the., use of the R&O program. or material3. ' 

The prificipal*s score on incorporation of th^R&D materials consisted of the 
proportion of these steps— i.e., how many 'out o'f the eight possibilities—were 
rated as having already occurred. 



Teachers were asked whether they planned, to continue using the ♦ • 
adopted R40 materials^ in the future, and if so, -whether they would use it 
with litt'le or no modificatioris, sorae modifications, or major modifications. 
The school level teachers* measure of product incorporation wa? calculate^ by 
taking the prc^ortion of teachers in eafch sphool who indicated they would >^ 
continue *using the materials without major modifications. 

In the CCF data, product incorporation was a^ssessed by our staff 
in terms of th? likelihood that over the next few years, the product would 
be dropp^(l), whether some or all teachers would use the product, but 
not extensively (2), or whether some or all teachers would use the produc^t . 
extensively (3)* 

All three measures were standardized to unit variance about a mean of 
zero. The ariltoeLic aveiage tnese standardized measures was taken as the 
final school level measure of product incorporation. ^ * , ^ 

RDU Program Impacts on the School As an Organization 

Like the RDU prograro impacts on participating staff, impacts on" 
the schools- as organiMtioos were readily observa^^in tour early site *. 
visits, and our study design was revised to include assessing such impacts. 
To triangulate on these unintended program effects, measures of organizational 
impact were buLlt into the survey of principals, £he^ survey of teachers, and 

the tCF d&ta. . ^ ' 

^.In both the survey of principals and the survey of teachers, respond-* 
ents were asked to rate how a number of factors or characteristics had 
changed in their schools as a result of the school's involvement in the RDU 
program on a scale from 1 (got , very much wdrse),to 5 (got very much better). 
These factors or charact^ristic§'*were: 

* a.' Curriculun • • i^ 

b. Available materials • ^ 

c. Teaching methods you use la your classroom * 

d. The w^y your classroom is organized or managed* 

e. ^T^e way your school is organized or managed 

f . Degree of participation of teachers in making decisions 

K . about this school / 

> 

g. Frequency* of communication amongj^achers about curri- 
culun, teaching techniques and lesson planning- 



*Not included in principal's survey. 
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Morale of the staff 
!• , The way^ specialists are used in your ,school 
* * , j# The ways in ^ich problems are solved in ^our school y 
k. 'The image of the school ^i^' the community 

Teacher and principal scores were calculated by taking the average 
of their respective ratings of th^ changes RDU produced m these factors* 
The school level teachers measure of Qrganizational Iimpact was generated by, 
taking th? arithmetic average of ^eachers* scores within schools* 

The CCF measure of organiziitional' impact was based on an expanded but 
similar battery^ of items, rated^ the same way. The CCF items were; 

a*^ Staff knowledge of* problem-solving practices 

b. ■ -Staff SMc.r£riC33 and ^^cepUncc of Rip products 

c. PiJpil petformance and behavior , ' 
' * d. Teacher morale 

e. Frequency of intprstaff coiamunication 
, f, Curriculin and/or^matefials 

^ \ 9- Teaching methodologies • ' \ , 

^ h. Organizational structure . ^ - ' * ' 

1. Teacher participation in decision-making 
- School'^ mage in the <hstrict 
k. Severity or. scope of the problem ' ^ * 

1. ' Use of specialists % ^ . , 

m. Community or pdrent involvement • ' 

.n«' Classroom brganization o;^ management 

Ov Other (specifyO: ' ^ 

Trie th;ee measures of or'ganizatiQnal impact 'were standardized to 
unit variance ^ouf^a mean of zero. The arithemetic average of these three ^ 
standardized scales was taken as the final school level measure of organiia- 
tional impact* / 
Incorporation of the RDU'Problem Solving Process 

Along with incorporation of an R&D product into normal 'school operatior 
th^ incorporation of more rational and broadly participatory decision making 
practices at the school' level Aas a prime aim of the R&D Utilization Program. 
Data on incorporation of the process was drawn from two sources, the principal 
survey and the^ teachers'' survey* 
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In the pnnc-ipal survey^ respondents were ^ked to indicate how 
'likely It was that their schoor would u§e several aspects of the RDU approach 
to problem solving*to address future needs. Each aspect was rated on a scale 
tanging from 1 (will definitely not use) to 4 (definitely will use). The 
process^ aspects were: • ^ 

< #4 

a. The use of a jtean or coiwnittee of teachers and adminis- 
trators. i ' 

b. The use of the services of an external linker. 

c. The approach to the process of identifying and iihproving 
m this school. 

^ d. The approach to identifying ^possible solutions to our ^ 
-problems. 

• e. Thp 3D?jrnach to makina a decision among alternative 

Swiutions to jb problem. . • * » » , 

*f. The approach to planning for inplementationT 

" " " ' • 

q. The approach to implementation and feedback. 

The principal's score for process incorporation was calculated by taking 
the proportion of aspects~i.e. , hgw many out of 7--the principal indicated 
wpuld definitely be used again. 

In the teachers* survey, respondents were asked. to assess the extent 
"to which the RDU problem solving approach- had.ii£en used to address other 
school problems. The school level teachers* measure of process incorporation 
was derived J>y, taking the proportion of^eachers at each school who incficated 
they were using all or^paH^of thrpDU process to solve another problem, or 
had definite plans to do so in^ the future.' 

Both the principals' and the teachers* measures were standardized 
to unit variance about a mean of zero. The arithmetic average of these 
t>o standardized scores >Kas taken as* the final sclhool level measure of 
incorporation of the RDU problem solving process. ' 

Need for Local Development of Materials ^ 

A measure of local adaptation of the adopted products and materials 
was developed by having teachers rate the extent to wh^ch the following ^ 
statements about the adopted program >iere true: 

# it Was necessary, to use materials frjom several R4D based- 
prcfgrans in 'order to meet your need or solve your problem; 
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• it was necessarsy to develop additional materials iocaliy 
in order. to meet your need or solve your problem; 

— • edifications were required* to' use* tljp program and materials 
• in yout school* 

* "These items were rated fromO - "not at all" to 4 = "to a very great extent." 
The teachers' ViajfSs were comput_ed by sunming the ratings across these 
three iteras. The school level measure was computed by taking the arithmetic . , * . 
nean of the scores of teachers, within tfie school. This was then ^^^^^^^^^^^w- ^' Cy 



to unit variance about a mean of zero. 
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2.0 IKDEPENDENT SCALES 



V 



Principal's Influence on Decisions ' , • 
Tfeachers' Influence on Decisions 
Central OPfice Influence on Decisions 
Local Action Team*s Influence on Decisions 
Influence ot> faculty as a Vfhole on Decisions ^ 



In the problem .solving activities, it was possible for a variety 
of actors to exert influence over the decisions made during the problem 
identification, solution selection, and planning for implementation phases 
at e^ch psrticif»J>tinf; srh'^H- ^hp CC^ data incline assessmpnts by our 
own project staff of the amount of influence of each such^role. group during 
each phase, rated on a three point scale; 1 = none or vVry little influence; 
2 = some influence; and 3 = a gread deal of in fluence._ Separate influence 
scales were developed for each potential role: building principals, teachers 
as^a group, the local action team, the faculty as a wholei and \he district ^ 
central office (including the superintendent and other district level sta'ff). 

- for each role group, 'an influence score was calcAilated by summing 
the ratings of that group's influence over the three phases. The resulting 
scales were then standardized to unit variance about a mean of zero^ 

Principal's Involvement in Problem Solving Activities 

A major feature of the RDU project was-its atiempt to get school 
staff and admiQli^trators involved in a series of problem solving activities. 
A^Sart of the survey of principals, respondents were asked to indicate the 
leveP of their personal involvement in four types of activities: 

"a, identifying the most insporUnt problem or needs; / 

b,* searching for and choosing an RiD based prograff/or 
'materials; 

c* making plans for how best to implement_thej:hosen 
R&D bas^ program ot'^ihaterials; and - ^ 

d^ actually* implementing the program -or use of materials* 

r ' ' ' - 



Ptincipals were, asked t;o rate their own level of involvement on a five-point ^ 
scale Vor each type of activity, where ^1 = no involvement and 5 = high 
involvement. The scale Vas calculated !^ sonming the principal's self ratings, 
and then standardizing to unit varianccj^about a mean of zero. ^ 

Scope of Involvement in Problem Ictentjfication , ^ • 

Scope of Involvem ent in Solution Selection 

Scope of Involvement in Planning for Implementation • * • 

Scope of Involvement in Implementation 

• - • ■ 

^ An important aspect of the improved problem sdlving process which 

the RDU program promulgated was a broacJenina of participation in local 
decision %z^\x>%. Th»t tQ^ the approach ain^ed at invplving as many role 
grpups -^s possible in the decision making process.^ the CCF data ^^eflect the 
involvement of five role grqjips in di^ussions, mali'irjg decisions, and carrying 
out tasks, related to the process: the, superintendei^l/assistant superinten- 
dent; other district level staff (such, as curriculon specialists, sti>ject 
area coordinators, etc); building principals/assistant principals; teachers? 
and other school level staff, such as guidance counselors, librarians, 
etc. 

Each such role group was^fated on the ext^t to which they were ^ ^ 
act'ively involved during each phase usin^ a four point scale: 1 = to little 
or no extent, 4 = to a very great extent. The scope (or breadth) ^of involve-^ 
ment for ea^ phase was scjsred by sonfling the involvement ratings of these 
five groups. The xesulting scales were then standardized to unit variance 
about a mean of zero. - • * 

level of Effort Devoted to Problem Solving 

•{ . 

A measure of the level of effprt 'devoted to problem solving ^ras 
calculated by estimating the nanber 6f persm days expended on problem 
solving activities during each phase pt each school on which CCF data were 
available. (The surveys of princ^pals^and teachers did not include such 
estimates.) For each ^)hase, fewer th^'an 10 person days Was considered a low * 
level of efforvt and was coded "1"; iqj-JO person days was considered a medium 
level of effort and was coded "2)} finally, a level of effort in excess of 30 
person days was consideired high and coded "3"* i 

■ ' . f . . 



The measure of lev e} / of effort was computed by sunming ihe codes 
(from 1 to 3). so g«fierated,over the problem identification," solution selec- 
tion, and planning for implementation phases* Hus score was thert standard- 
ized to' unit variance about a meah of zero* ^ ^ 

Quality of Group Decision Making Practices 

The ROD program' s'aim of improving local decision making jpractices 
included two components: making the problem solving^ activities |ore* national, 
•and making th? participation in decision making more broadly representative 
of the groups who would be affected by thp decisions made* The criteria 
for assessing the quality of group "decision making processes included the 
following: ^ . < ' 

• a for^ali; vofiSvi^B|||cJ ciuup efflpowe£ed*lo make 
decisions; • 

^ • regular meetings, well attended; 

• representation in the group of those who *ill be 
affected by its* decisions; 

3 collective deliberation and democrator decision 
making; 

• ^effective conflict management; 

• decisions nfat subverted by administrators; and 
. • continuity of group membership* 

For 'each phase of the problem solving activities, the CCF data include 
ratings, bjpsed on these criteria, of the extent to which 'the school's problem, 
solving activities were congruent with sound g^oup decision making practices* 
The four point rating scale ranged from 1 = "to little or no extent" to 4 = 
"to a very great pxtent*" ^ • ' * . ' 

The overall rating of ttie quality of ^roup decision making at each 
,site consisted of the sum of the ratings for the problem identification, 
solution selection, and planning for implementation phases* This sun was 
then standardized to unit variance about a mean of zero* 

Quality of the Prot)leln Solving Practices 

^ • 'a 

The' second component of tbe RDU program* s intended irnjnrovements 

in local decision makitig was the emphasis on rationality in th'e problem 

.solving* The CCF data included ratings of the soundness of the problem 

solving practices at each stage* Since the content of the decision making 



varied by stage, the criteria for soundness of problem solving practices also 
vary by 'stage. Sample criteria for soyn^ofiS^^f problem identification 
irtclude: , 




\ % problem specification needs assessm^t prior, to searching 

for a solution; 

% consideration of alternative definitions of the problem} ^ 

' • obtaining adequate evidence of the proble^i*s existence; 

' • developing a definition of the problem which is clear, 
manageable, and relevant— neither too trivial nor too 
grandiose. 4 

During solution selection activities, other criteria become relevant, 
such as: - ' 

• obtaining evaluation evidence of a solution's effectiveness; 

• careful examination of alternatives; 

•i the solution is man^eable given cost or other constraints; 

% the solution is relevant to the problem statement; / * 

• the solution is acceptable to a majority of those affected 
by its solution* 

Finally, during planning for implementation, still other criteria come 
into play, such as: , 

% realistic assessment of constraints on implementation; 
% gaining administra'tive support and cooperation; 

• detailed formal plans are drawn up; . 

• measures are taken to ensure the. chosen product retains 
, its essentTLal fe^^u^e?^ end 

• adaptations before or after implementation are* appropriate, 
'to the situation* 

Calculating a score for a site*s quality of problem solving activities 
was done by rating the site on the extent to whJ,ch their activities conformed 
to the criteria relevant to each stage. Conformity to sound problem solving 
at each stage was rated on a scale of 1 = "to little or no extent" to 4 = "to 
a very great extent." These ratings were then summed over the problem 
identification, solution selection, and planning for implementation phases, 
and the resulting scores standardized to unit variance about a mean of 
zero. " ' 
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Level of" Linking Agent Activity artd Initiative 

Linking agents performed a varying array of advices at the schbx^s 
with which they worked during the ROU project • 'Stffce they constituted one 
of the primary RDU "interventions" or "treatmfents'S it was of great interest 
to develop a measure of thp level of effort fmkers expended at these sites, 
along with an estimate of their level, of influence over the local decision 
making process. To obtain such * • * * 

measure, linkers were rajted on the extent 

Ip Which tbey performed each of the following services at site represented on 
the CCF data base: * ... 

• Providing ( not arranging for) training m problem solving 
or oroup process ^ • ^ 

^ • Providing (not arranging^ for) training m a curricular 
area 

• Facilitating the group process-e.g. , by resolving conflicts, 
guiding discussions, helping to set goals 

• Coordinating/lining* up resources (hunan or material) 

$ Providing expei^t counsel/technical assistance related to: 

^ ' - Diagnosing the* problem 

- Assessing the match between innovations and problems 

- Implementang an innovation ^ j 
Evaluating solution implementation or effectiveness 

• Provi4ing assiftanfce such as interviewing, helping with 
/ proposals, etc* . ^ ^ 

^ % I Serving as a communications Imk/liaison between school 
qnd project. 

The ratings were from 1 = "to little or no extent" to 4 = "to a very great 
extent." Similar ratings on the extent to which the linker became heavily 
involved and assumed direct leadership of the local process, and th? linker's 
importance m helping t|ie school to accomplish its problem solving activities 
were .ai${^«le, along with ratings-«l*he linker's influence over decisions 
at each stage. — ^ » ^ , • 

These ratings were then summed to produce a general measure of linking 
agent activity and initiatjv^ This sowe^^ then standardized to unit 
Variance about a mean of zero. ' i 
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Amount of Linking Agent Time^on -Site ^ 

Artother ineasure of t^'. level of linket effort devoted tp each school 
was computed from the CCF data by rating Ihe linker's frequency of fece^to- 
face contact w^th school stflff during each phase of the problem solving 
process* frequency of contact was coded as follows: I = •Hess than once per 
month;'' 2 = "at least once per, month;" 3 = "once per week;" 4 = tiroes 
per wpek;" and 5 r "roo^ than three tiroes per week."J 

Amount of linking, agent contact with the local action team was 
scaled b> summing these codes across the problem identification, sojution 
selection, and planning for imJ)lementation stages* This scale was then 
standardized to imit variance about a mean of zero. 

\ Amount of Linking Agent Contact with the frincipal ^ 

In the survey of principals, a single item asked the respondent 
td indicate the frequency wi^h which he or shee personally had face- to- face 
contact wiCh the linking ag^t* The four point «cale ranged mis "no 
contact" to 4 = ''a lot of contact." This was standardized to unit variance 
about a mean of zero* - / 



Linker Innovativiness 
Linker's Political Orientation to Change 
Linker's Individual Orientation to Change 
Linker's Structural Orientation, to Change 



I 



A variety of linkers' job related attitudes were examined in relation 
to various school level outcome,measure3r"'*TT?fe^easure of linker innovative- 
ness was taken from Price (1972) and involves the forced choice selection 
between pair's of adjectives describing the respondent's behavior* Relevant 
data were drawn form the surveys of linkers* 

Four innovative characteristics (independent, flexible, original, 
and self-reliant) were paired with four conventional characteristics Cdepend- 
sble, cooperative, industrious, and 6£able)'. The battery was scored by 
adding the number of limes an innovative^adjective was selected over a 
conventional adjective. / • 
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Jt, Linkers' scorfes^bn^the structural,^ political, and individual 6ri6nta 
tions to change were measured by* asking the ag^nt, in the linker surveys, to 
complete a set of six *forced-choice^que8tion8. Each question paired a 
statewent reflecting! one of the perspectives with ja staEecnenf reflecting 
.another perspective. Each time the Unket made a choice, he* or she was giye 
ore of 1 for thetorientation that they^fiose.' Th^s, the possible range 
for' each orientation was between 0 and 4. The items for; each perspective 



were: 



• ^ ^1 



tical perspectives ^ 

- Competition between interest groups in K:hools is 3 

* major Tjarrier» to change. - ' ftf 

- Understanding the actual power structure pf Ihe school 
is the key to designing successful change efforts. 

- The iirst^step in developing a cHange strategy for > 
school^ IS to asisess the current coalition in order 

to mobilize positive support 'and anticipate possible 
•backlash. ^ 

- If an innovation can be made i(S appeal to -the most 
powerful individuals or groups in the schools, the 
change wiU'occur^ 

Individual incentives perspectives ■ 

- Lack of individual skills and knowletjpe appropriate 
to the new innovation is a major barrier to change. 

- Undei^tanding the individual, needs and concerns' of 
staff pembers who maj' be affected is the key to de- 
signing successfurchange efforts. *^ 

Resistance to change by individuals is thfe^ major 
re^ian for failures of most change programs in 
schoczs. - ' - ^ , 

- -Effective^change in schools requires that individuals 
^ internAize the need for change. 

Structural perspectives ■ 

- Poor management and coordination are the most impor- 
tant barriers to'&ffective change in schools. 

- Effective change in schools requires critical evalua- 
t^iQp of existing roles Jind activities. 

- The first step in developing a change^ strategy for 
. schools js to .assess the level of school-wide re- ■ 

f sources, such as "group problem solving sk^ills. 

,If the way m which jobs and responsibilities are 
, defined in .a school can'be made supportive of a new 

• innovation, then change: wi^U occur. ^9 



All scales reflecting linker perspectives were standardized to 
Unit variance about a mean of zero. 

Total Amount of Trqining Teachers Received for Implementation 

A measure of the use of external resburces, the school's value 
for total amount of training received represents the/propd»tion of teachers 
at the school who reported receiving 25 or more hours of training irt the use 
of the adopted product or materials prior to impleaientation plus the propor- 
tion of teachers who reported receiving 25 or more hours of training in 
product yse during the tirst year of amplementation. This measure was 
standardized to unit varianbe about a mean of zero. 

Number of Sources of Training Teachers ReceiV'ed j ^ 

The nunber of soQrces fiom which teachers reported having rec'mved 
training, in- product use provides another measure of^the use of external 
xesources. These sources included the following: district or school-based 
specialists; other district or school staff; the developer of the adopted 
product; the linking agent; other individuals from the operational project; 
other outside consultants. -The school level measure of nunber of sources 
o£ training was computed by taking the average number of training sources , 
reported by teachers within that school. This value was standardized to unit 
variance about a mean of "zero. , ^ ♦ 

^ . ■ . 

Teachers' As ses^ent of Product Quality - 

^ « — r ^ 

As dis'cussed in the body of this report (See Chapter 4), the charac- 
teristics of the adopted products and materials proved to be of gtMt analytn 
value and produced some of the most policy relevant findings to emerge frcm^ 
this study. A particularly useful scale was a measure of generaf product 
quality,, developed from items' m jthe teacher questionnaire. Teachers w*e 
asked to rate the extent to wh'ichlhe adopted program or materials met fQJJr 
criteria: ■ " . . • 

' ^ # seem directly relevant to the md^t pressing problem or 

need in their school; ' nifr j 

meet a need in the classroom; 
• provide adequate guidfance for implementation;' and 
• ' • provide new ideas and not just ideas teachets already ' 

.knew and were usin^ ' ^ , , - 
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These items were rated on & scale ranging from 0 = "not at all" to 4 = "to a 

« 

very great extent." 

^The product quality scale was calculated by summing the ratings 
of these four items for each teacher who responded to the teacher survey. 
The school level measure of product quality was calculated by faking tha 
arithmetic mean of the teachers scores within the school. This was them' 
standardized to unit variance about a mean of zero. V 

Difficulty of Product Imp^^entation 

A measure of how difficult teachers felt it was to implement the 
adopted products, and materials was developed in the teacher survey by asking 
respondents to rate the extent (0 = "not at all" to 4 "to a very great 
extent") to which the roiio^^ing S'-atements about the adopted product were 
true; 

• requires substantial change from previous teaching 
style7 ^ 

• requires' change iq the way the classroom is organized 
* ^ or managed; , ^ 

• requires substantial additional record keeping; 

m- has been difficult to implement the program or materials, 

0 

A difficulty of implementation score was calculated for each respondent 
by summing the ratings on these four items. These were then converted to 
a school level measure by taking the arithmetic mean of the teachers' scores 
within the school. Finally, the school level measures were standardized 
to unit v£^iance about a mean of zero« * . ^ 



43 



A 



APPENDIX C-. 



In the analy sis V presented ih this report, the nunber of case^ inclu- 
ded— i,e,, the nunbers of cases on which relevant data are availbble—in any 
given ^analyt^c run vary, widely* This is due to the fact that as part of the , 
research deysign, we proposed to identify a subset of about 91 sites (schools) 
which we called '•intensive study sites." More detailed and extensive data 
would be collected on thes? sites, which would later serve as the basis for 
some of the more critical analyses, of program impacts* 

There are a total of about 200 sites on which data are available 
from an^ of the sources identified in the tSxt: our own visits to sites, 
case studies, linking agent surveys, the survey or principals,Vand the survey 
of teachers. However, N's vary from this figure (200) depending on which 
variables, are included in any given analysis. A total of 152 principals 
returned useable survey questionnaires. There were 461 useable teacher' * 
questionnaires returned (plus another 133 from schools which had not yet 
adopted a product, so most of the questions were not applic^le, representing 
179^schools. , Note, however, ^that not all of these schools are represented by 
data from principals; nor do all 152 schools from which principal surveys 
were returned have corresponding teacher survey data. Site level date on 
linker survey varia1)les were provided for 130 sites. Finally, there are the 
90 ''intensive study" cases. ThuSj't'he tbtal of 200 sites includes cases on 
which every conceivable combination ^of data might be available, as shown in 



the Venn djiagrara^: 
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Consequently^ if our analyses draw on variables from more than, 
one data source, the number of data cases theoretically available is limited 
to those on whjich both {pi all three) data sets are available, e*g/, if 
we correlate. principal variables with teacher variables, the N drops to about 
130, Missing data withm either or both of thege data sets may reduce the 
nunber of available cases still. further . The shrinkage is even more conspic- 
uous if v.ariables available only from the consolidated coding form — the CCF, 
or ''intensive, study sites"--are Jtnvolvaed sihce there are only 90 such sites 
to begin with. In Table C-1 we present average numbers of cases' for -analyses 
using various' combujations of 'data sources. ' ! 

This raises an important question; to what extent are the data 
cases in analyses which involve shrunken N's representative of the full data 
base? That is, are tht cases m any given analysis biasing ouf findings? 

As we discussed m the project's Revised Study Design (Louis et 
al, 1978) and m the data analysis plan (Louis et al, 1979), we intended 
th^ bulk of the analyses of program impact to be concfucted xj g the "ifkten- 
sive studjf sanple" of 90 cases, since these cases had the mOi. oroad coverage 
"m terms of the variables of ^interest. The full sample would be used to 
provide important descriptive information and for scaling, but would lack 
the in-depth data of the intensive study sites T However, at was possible 
that *tfte subsets of data cases might be biased m terms of site characteris- 
tics, program outcomes, or both. * 

To investigate this possibility, we conducted a series of analyses 
comparing the several analytic subsets of the data base~i.e., N=90, N=75, 
etc. A set of twelve "key" variables was identified, including th^ categori-j 
cal and distal outcome measures, and fi\e indicators of sa.te characteristics. 
Thj? intensive analytic qjata subsets was .first compared with the rest of the 
full data set using the analysis of variance. The results showed that witj 
the excefStion of being somewhat higher on the two spinoff program e^P^cts— 
iftpact on schools as_ organizations, and personal impacts on staff^the 
intensive study sample did not differ significantly from the rest of the data 
set. . p . - • 



. Table C-1 

Average ^NuTiber of Cases in Key Analyses Using 
Different Combinations of Data 'Sources 



Data Sources 

4, Individual .teacher 
survey data 

2^ Principal survey , 
data 



3. CQF, aggregated , 
teacher survey - 
and principal 
survey 

4« CCFy aggregated 
teacher survey* 
and principal 
survey 

5. CCF, aggregated 
teacher survey » 
principal survey* 
and linker survey 

6. Principal Survey 
and CCF 



Representative Analyses 

1, Description of personal 

impacts, Ct\;^4 

■ " * 

2* Desctip'tion of extent to 
which problem solving 
process incorporated, 
Ch. 

<v 

3, Relationship betvreen problem 
solving process and school 
outcomes, Ch* 6 



A, Relationship betvreen product 
characteristics and school 
routcomes, Ch. /3 * 



5^ Relationship between combined 
intervention strategies and 
school^ outcomes, Ch, 5 



6. Relationshp between school 
characteristics and 'school 
outcomes, t:h, 8 



Average N 
A50 

150 
7^-90 
60 



75 
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When the still snTalder subsets of the intensive cases— i.e., N=75, 
N=60, and 'Nr43--were compared with the remaining intensive cases, systematic 
differences began to emerge. The smaller subsets showed significantly 
higher roeans on several variables as summarized in Tab-le C-2« 

We also compared the standard deviations on t|le comparison variables 
within the data sublets to see if reductions in variance accompanied the 
higher, means, which would make the estimates of relationships presented in 
the text more conservative.. However, for all the comparison variables, the 
standard deviations were almost^ identical, sometimes to the second decimal 
place. ^ ^ 

Our conclusions from these analyses are that the intensive study 
sites are well representative of the full data base. However,' the small 
analytic subsets of th«» intensive^S8<rpie are ccii5istei>ti5^ biased toward the 
high ends of the comparison variables, though no effects on variance were 
deleated. In terms of the effect^ these considerations may have hacf on the 
regression results presented in the text, we feel* that while estimates of 
intercept terms in the regression models based on smaller N's may haveieen^ 
artificially inflated, these were not the foq^ of interest* The real 
assessment of program impact was based on the regression coefficients (the 
Bet^s) themselves, and see no bias for suspecting bias m estimates 
of these coefficie 
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Table C-1 'w 
Coropansons of Analytic Data Subsets of Intensive Study Sites 



^ Comparison Variable 

Categoricaf . 
Outccoie 

,« Extent Problem 
Solved 

Organizationsrl 
iB^pacts on 
Schools 

Personal Impacts 
on Staffs 

Incorporation of 
Program ^ 

Incorpora^on of 
Process 




Scope of 

Implementation - - 

School Level 

'Nunber of' Pupils 
Enrolled 

Size of 
Comnunity 

level of Teacher 
Influence in Process 

Teacher Openness 
to Change 



N=75 



= .01) 



Data Subset 
N=60 



4 

1- 



|t = .002) 



( = '.000» 



t ( =\001) (' = .0001) 



N=43 



( = .001) 



( - .0001)_ 



( = .001) 



( =*.oi) 



( =*.05) 



{ = .04) 



( ~=*.fl5) 
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*A V indicates a significantly higher mean m the stAset of cases 
than in the reroainmg casea* , ' _ , 
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APPENDIX 0 

Instrunents: Con^iidated Coding ForA- y 
Teacher Survey ancJ Principal Survey* ^* ^ 



*Cdpies of the field guides that were uspd to direct visits to , 
42 schools, and surveys of Fi^ld agwfs may be obtained by / 
•writing to any of the authors. 
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A Study of th« KtQ UttHxitlOfl Progri 
CONSOLIMTtO COOINS fOW 



V 



Project: 
$lu: _ 



□ 

Site io# r I 



Llpkir: 
Codtn . 



Unktr IM 



tktA Soureis- tt TKi LIKE TO THE VEFT OFtAOi OOClKIIT. DOER A '1" IF TW tiS^U'SI^*'*?,, - 
(MU Sogr^J. Jj;^{g,ji"^5'';^'55.'tF jT tUS KOT. FOR EAOH AVAILABLE OOCl»«lT. EXTER THE 
MTE OF THE DOOICHT AT THE MGHT. • 



T, QuestloftnJiIrt 
Sitt visit rtport (MI visits) 
Sitt rating shttt (AAU^Islts) 
Sitt C4st study 

S1U rttloQ c«st 
study vrlttrs 

KtiU9«Mnt <lt11vir4b1ts: 

Problcfl Idtntlflcitlon 

Solution sticctlon 

Minnlng for kiplsitntitlen 

Ii9liMnt«t1on 

Sitt dtsaogripMc fora 



/ f 



I / 



— I 



I ( 



TABLE OF COKTEKTS 



S1U Dtflnltlon 

Or^inlzitlonal ChtrtcttH sties 

. Conttxt wd P^ctdtnts ^'^^ 

ruturt of tht ^blcB ^ 

Problvi Idtntlflcttlon froctss 

Chtrtcurlstlcs of tht Solution 

Solution Stitctlon Proctss 

Product ij^lMAtttlon Factors 
tnd Outtt)ttH * 



10 

16 

22 



Planning for Iipliivntitlon 
Proctss 

IrpltMAtttlon Proctss 
Inttmal Strittglts tnd Ttctlcs 
aUmtl Strtttgles and Ttctles 
Proctss Outcoots 



76 
30 
35 
36 
38 



Organlittlonti OutcoM tnd 
Outconts for Ptrti dotting SUff 41 
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iH PORT All T 
(Wntril InttrvcHons for ConsolidaUd Coding: ferat 



Pletst prtivid* a wi tUn rtsponst to eich qutstloo* i^ludlng etch of Its subparts U*b,c,*.*) (f any. 

a* For questions rwiriiig you to writt a nimrlcal answer (as In Question 2) write "0* If the 
answer is 'none't write if the data are alsslng; write "-J" If the data are conflicting; 
and wriU *0' if tKequestion is not appHcable* 

b« tf '0* Is given as a ni«i6er code (as- In Questloo 22), please wHte *Q" wherever this respons*e 
is appropriate* Vrlt* ''-T'* only if there is no inforvation to answer the question, and fn 
that case e»ter the "-T response for all parts of the quesjtion, 

1 • J • 

Do not leave any Iten blank except In acconUnce with skip Instructions. 



* ^ * , * 1 ,1, 

Z. The following codes are standard throughout the forn: 

-^1 « Hissing dau (i\e., the information Is not provided by the available data sources, 

or it is unclear, or It Is presented In a.sanner that Is incoopatible with the 
response categories) 

•2 « ^fllctlng dau (i.e., the in/omat1on from different data sources or respondents! 

or eve-, tnc si-rci: cr rsii I, ccinrlilctcry) 
I ■ ^ 

-3 " Hot applicable , , . 

/• 

3. Please try to avoid using the ■missing data" or "conflicting daU" response categories. If 
you are merely unsure of the correct answer, please respond anyway and use the certainty 
code (see M beTSwTtb Indicate your uncertainty. • ^ * * 

' ' • 

4. For each question (or subpart a,b,c,.*J please Indicate how certain you are of your response . V 
by circling either "1" or "2" In the aargln. Please do this even for your "wissing data" and 
'conflicting data" responses— for exaaple* to Inllcate whether you are reasonably sure or not 
vei7 sure the data really are «1ss1ng* i ^ 

1 « Reasonably sure 

■ 

2 « hot venr sure 

5. Question 3 asks you to najoe the one school that was tost actively Involved In the project at 
this site. Please we this schdoTas your object of reference throughout the coding font. . 

At several places In the fora, you are asked to focus your responses on only one problettf 
product, or declslcn-oaklng group, alt^j;h *n f-ct core than one «s4y have been Identified. 
The problem* product, and group you;descr1be just all bt part of the sawe "story." 

a. Start by selecting the product for which we have the Bost daU. 

b. Then identify the oroblw It was Intended to address. If the product was targeted to 
4^ ttore than one probte«i« choose the problen for which we have the aost data. 

c. Mext, at ekch stage of tht probl«i»solving process, select the group »^se activities 

were relevant to tht product and/or proble« you have chosen. Again* if there is aort • 
than one relevant group at a* given stage, choose the one for which we have the nost data? 

7. Tht following definitions are standard throughout the foni: 

a* District: this refers^nly to tht loc4l school district, not the Internedlatt school 
district. If one exists. 

b, guoerlntendent/Asst. Suot.: Superintendent, Assistant Superintendent, Associate Superln- 
tendenti Deputy Superintendent— In fact, anyone at tht local district level with •Superin- 
tendent" in his/her title. * ' - 
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Othif dittfict*! 
incitKllrvg both « 



stiffs 111 distrlct'Uvtl sUff ¥ho do not fit ondtr definition 7b ibovt. 
inciugirvs oout «wnTstritbrs «nd spKialilts. Exuaplts irt^ €ufricu1&t Director, Curriculum 
Coordinttor* ftdtral Progrw Coordinator. Titit t Coordinator, Vocational Education DirKtor. 
Rtadin) Coordinator or Specialist, etc. 

Principal /Asst. Priocipal; .Principal, AssisUnt Principal, Vice Princtpal-in fact, anyon^ 
at tne school level with "Prfncipal** in ttis/her title, \ 

Teachers : only teachers with regular classroon teaching responsibilities (and not, for 
exaopit, a raiding specialist %rho pulls l(ids put of the classrooa for rc&ediil instruction). 
N.S. . a few Quastions are limited to "teachers involved in RDU.* This is always explicitly noted. 

Othtr school 'level 'sUff; all school-level suff who do not fit undec definitions 7d or 7e 
above* Exaaples are;~Cutriculw Director, Curriculua Coordinator*, Title I Coordinator, 
Reading Progran C^rdinator, Reading Specialist, librarian, Media Specialist. Teacher Aide, etc. 



If your response t<ould viry greatly .for different uetibers of the sane cate9ory-*for example, the 

Principal ind Vice Principal^ or the Superintendent andAssisunt Superlntendent-^choose the 

response that is appropriate for the individual Mho-was nost active in the ROU activities. This 

general rule does not apply* however* to the Teachers category, in which case you shoOld try to 

deflne^the wajority opinion. 

o . # , * 



For all cite^jorles exctst the Tercher; ;;te5&f>. tf yog have information on anyone in the 
category, choose the response appropriau to that person* even though you nay not hive 
infomation on others ip the category. For exanple* if you know the AssisUnt principal 
was very pleased with the adopted product, but you do not know Mhat the Principal felt, code 
the AssisUnt Principal's opinion. ' 



* * 



1.V 



1. SITE ocFiwmw . , 

1. idMt Is tht locuj of tntervtfltton «t this Htt~l.t., to »«h4t Itvtl *rt the project's strvices 

«rlMrny dolivtrtO? (CIRCLE OKE) ' . ' . ' 

. Entirt school dUtrictt ill P«bHc schools «rt involved Dl 

Entfrt school iistrictt but not «11 public schoals 4rt involved 02 

Oot school. . I * ^ > °^ * 

Other (pleise sp«cify):J , L 04 

Hilling d*u. -1 



Conf11ctl09 dtt^. 



2. How nif^y schools of ttch typt art involved ^h the project «t this site? 
(DITER A rwCER OHTACH UKE) 

I, Prinary or tlemtt^ schools* . • 

. Hiddlt sdiools. n • ■ 

c. Jvwior high schools ' ^ 

4* Sfflior high schools, t ■ * . . ^ 

e. Other (pteise 'di^scribtl; 

7. Please nw' the one school th«t is «ost actively iDvolvtd in the project it this site (and use 
it «s your objKt of reference throupout the rest^f this font). If snre than one school wis 
wjtlly Involved, choose the school on which there Is the nost dau. 



II > (yGJUilZATlOem CHARACTERISTICS ' ' 

4. Which of the folTOMin? best describes this school r (CIRCLE ONE) /^ > 

Primary or elementary school* 01 

* HMU school. . . . -* , OZ 

^ior hign school * 03 

Senior high school / - 04 

Other^ (pleise descrlbe):^ ^ ^ 03 

«iss1h9 <uu* . • • • -1 

.'^ Conflicting daU,% • • ; ^ ........ • *2 



^ 5. How Muld you describe the commity in ivhich the school is loci ted? 

^ (CIRCLE OWE) ^ 

ftiral area ; • 

S«ll>c1ty^or town (pop. under 50,000) not neir a lirge city. . 
J Mediu««s1zed city or town (pop. S0»000 to 250^), 



01 
02 
03 
04 
OS 



Suburt neir a lir^e city 
Large city (pop. over ZSO.OOO) 

Missing daU . . *1 

Conflicting daU \ . -2 



54 



T 2 



1 2 



1 2 



9.)o,ii* : I 



12-13.14 
15-16,17 
18*19«20 
21-22.23 
24*25.26 



27-28.29 



30-3T.32 



) 



6: To Whit ixttflt 'hm tht foll^log c^4nct•riitT^^of tht ichool or lu coa^nlty cMng«d 



slgnifUintly ovtr pmTivt yt»r»? 

*4 ■ 



^, ' . *. R4e1ji.idrstr(l^it1on of leHooVJ 



tJ^ • 



01 ♦ 

* 


02- 


03 


04 ' -1. 

t 


-2 


01 
01 

or 


02 
02 
02 


• 

03. 

03 

03^ 


1 

04 -1 

64 -^li 

04 -1 


^2 

-i 



b/ Soclb-econoiax^ su\i« of schoot^^s 
. pupn>' . ^' ^ • 

c. Sl2t«of comunlty 

7. How i^ld you dtscrlbe tht toc1o-^no«1c sutus of £h« ichooVs currtnt ^lls?, 

IftaEOfiE) . ^ 

^ . . . . • 01 

, . . . 02 

. . 03 

t m m ^ • 04 

' It 

05 

.... * -1 





High . 

Low .... ^- 

K1xed'(ffore High thtn Ley),.. 



Mfxed,(iort Low thw High)* • • • i'.' . 



Conf11ct1n9 d«U. y 

) 



8. How minyvchools of ^ich type »rt there 4o the district In which this school is located? 

^ (EKTER ^Wf«ER ON EACH LIKE) ^ * 

i. Priiiry or ele«ntiry Schools. • 

5. Middle schools • - 

c. Junior high schools. ' • • # • • • 

d. Senior high schools... ■. ^ ^ ... * ^. 

f , Other (pleest dgicHbe): ' ^ 

* 9 How »any full-tici teichino positions »re assigned to this school, oA of how »any in 
" the district is > whole? (ENTER A MJM8ER EACH LIKE) ^ , ^ 



e. Full-tiae teaching positions assigned to the school, 
b. Full -tine tHching positions in the district . . . . 

4 * 



10. How B*ny puptls ire currently enrolled in this school and in tA district as a whoVe^ 



1^ 



(bfTER ThUMBER oh "EACH itlC) 

Pupifs eMlj|^ in thk school. 
1 ^Pupils enrolled in the district. 



11. Hoi rniiy profes'sionaT suff are there at the -dis&ttt levet? -(Include the «JPe»-}«tendent, 
but do net Include secreUrtal or clerical- sUff or ^thooj -level pertonnel who elso have 
distHct«]Vel responsibilUies, such as a prtocipal who serves as district curr^lu* 



coordinator.) 
(DiTER A IfUMBER) 

District level pjdfessloiul sUff' 



I 



EUC-^ 




55 



CARD 2 
(cont.) 



1 2 33-34.35 

3^7»38 
39-jlCl.41 
42-43.44 




1 2 



63-65.66 
67-71.72 



CARD 3 



9-12.13 
14-19.20 



21-23.24 



12, Coufttlfw tht suptrlntendent «s ont Itvel (tht top)» hw •iny itvels of professional 
•tuff iff tMrt In tht .d1strfct«l€v^1 orqinlzitlont (Do not count secoetarlsl or 
cliHcAl stiff or schooKUvtl pcrsonntl who also hm dlstrlct-lml rtsponslbnitl 



Cltrleal sUff or ictiooT\Uvil pcrjonntl 
(CIROXWE). - . 

One. . : - • < 

* * 

Tw> J 

Three 'j ' * ' 

Four or nort < . . . . 

Kisslpg d<ta. ... 
^ Conflletlnig d<u 



or. 

. 02 
. 03 
. 04 
. -1 
. -2 



13, Ooei tfie school h*ve tore Wim^ow adalnlstrator— «.<).> In adclltlon to th« principal does 
It «ls» have an asslsunt principal or arriculw director? 



Kissing d«u. • . 
Conf11ct1ri<g d«U. 



01 
00 
-1 
-2 



14. Wiat Is the current toul annual operating budget /or S^«,^istrict--1.e,, the" line" 
: of the budget? (ENTER THE NUMBER OF OOtLARS ftOWOECTO Titf KEAft£iT WHOLE THOUSAHO.) 



thousand dollars 



III. tOKTEXT Affl Pft£C£OENTS 

15. How would describe th'ls school's Imge 'in tht ccrtwilty «t the tlue It tntered the 
RpU proJectF % 

^ (9IRCLE ONE) . , 

Its iMgAwas «ouiy ftvorthle. , . . ^y. . ^1 

Its lB*ge WIS nostly unfavoriMe. . ! . * . 02 

Its luage wis «ljied» or ft didn't rtijly hm one . . : 03 

Wssln^ diu ^ 

Conflicting dlti - 



-1 

-2 



16.^0H(M would ^ describe the Innovrfcijreness of this school prior to the- WXJ project? 

(cinaEOKE) 

tht school hid dorte everything the Ji» wiy for yeirs 01 

' The school hid trle'il new pro^riiis or Ideis eoderitely often 02 

- TJ« school hid ttitil new pro^rw or Ideis quite fre<n»ently .f. 03 

Mifiing dlU- - . / 

Conflicting diti ♦ * * . * -2 



17. -This schooUwts pirt of which we of slus_ enttring the WXJ project? 
(CIRtt£OK£)^ 

first (or only) wave 01 



Secori^d or third Mve. 
Hissing data. ■ • ^ • 
Conflicting daU. . . 



02 
-1 
-2 



5g' , 



1 2 



(cont.) 



25-26.27 



1 2 



1 2 



1 2 



»1 2 



1 2 



28>29.30 



31-36,37 



38-39.40 



41-42,43- 



44-45.46 



. In yeuf opinion, to Mh«t extent ms eKh suge of .the fSM probleo-solvlng process essentlell/ 
KCoEpTlshed fiHor to the school's entry Into the ROg project? («OTE, He ere coocerned^hert 
orddecHI 
[itrSWT 

/ ..V *v <^ 



Mlth proqrtss tci<>rd dtcUIOffs (or 1«plMnUtioo)» not reUtlvt Uvtls of activity before 
*nc mtr tntry Uto "~ 

(CIRCLE ONC XESPO^Ej^ IKH imy 




a. 


Problcn Identification 


01 


02 


03 


04 


-1 


•2 


^ b. 


Solution selection 


01 




03 


04 


•1 


•2 




Planning for iBpleioentation 


01 


' 02 


• 03 


04 




X -2 


Iffipltoentatlon 


01 


02 


. 03 


04 




•2 



19. In your opinion, tihat kind of precedwts were there <t this school for each aspect of the 
WW experience listed below? KlKCuTCHE RESPCNX ON EACH II«E) . - - ' 



• -■<> 



a. Involvetnent in a federally or state 
funded sctiool inprove^nent progrm 
other than Title I 

b. Assisunce froAt linker or other 
in-person xonsul tant 

c. Assxiatlon nith the person, i-ho \ 
was naned linker 

d. Going outside the d^jtrlct for 
infomation or assfsunce 

e. Forolng a 1^1 problesa-solving tta« 

f. Adopting 4fnlnnovat1on 



' — !Y. MATURE OF THif PROSUM V 

20. Has this school completed its problefi Identification? 

Yes • * . • 



01 


02 


03 


04 


•1 


•2 


01 


02 


03. 


04 


-1 




01 


02 


03 


04 


*1 


-2 


01 


02 


03 


04 


.1 


*2 


01 


02 


03 


04 


•1 . 


*2 


01 


02 


03 


04 


•1 


*2 



(CIRaE ONE) 



Ko. they are still in the process of identifying the problem. . . 
Ko,^and they are noiTcii^rtntly engaged in problen identification. 



'02 
01 
00 



SKIP TO QUeSTICK 29 



2). 



MS cere than one problca Identified throusH the Initial preblesa Identification process? 

(ClRttEOKE) * . , ■ ' 

Yes. » 01 

Na 00. 

Mfssing data. ^ . . . . -1 

Conflicting data. . . : . • . --2 



•7 57. 



1 2 

1 '2 

1 2 

1 2 
1 -2 
1 2 



1 2 



.1 2 





CARD 3 




(cont.^ 


2 


• 47-48.49 


2 


50-51.52 


2, 


53-54,55 


2 


56-57«58 



59-60.61 

62*63.6r 

65-66,67 

68*69.70 
71-72.73 
74-75.76 



77-78.79 



CARD 4 
9-10.11 



WORTAKT* Your Mswtrt to tht rtwlnlo^ Questions on Iht niturt of tht problem should J 
* bt ooly'one problw. This should Jbt tht pro.ble«,.tddresstd by tht product you : 
5 dtscrlbt In Stctfon YL(set 6«neril Instructions). If tht product addresses «ore thin I 
S ont probltfl, choose tht probleoi on Wilch there Is the cost dau. 
* 



Uhit is "tht content irei of tht problem? ^ 

(01 Ua\ LIKH. EhWr A,-r IPTHE COHTEHT AREA IS iHapOEO IN THE PROStEH OEFIHITIOff W A 

'0' IF IT IS HOT,) , • / ^ 



t« Reedlng/languige trts 

b. KethcoUIci • T 

c. Ureer educAtloij 

d. Other specif Iq^lnstnitt^onil erei(s.)*,; 



Uhat chirecurlstlcs of the school's pupils or progri«s ire Includedin tht problea definition? 

(ON EACH CINE. ENTER A -r IF THE- CHARACTERISTIC* IS mUOEO IN THE pV»^ 

IFIT IINOT. E^ ONLY IF THERE IS NO INFORMATION R£tEVANT>^THlS flU^ IN 



THAT CASE. ENTER --r ON Aa llNES *-bbJ 
Puo'll Chiricteristlcs "^4f 



a. Perfonwnce in clais 

b. Rerf omaoce on sUndirdlzed tests . • 

c. Skins/knowle<l9e • . . 

Motivation . • : • . V . 

t. Other pupil Utitudes ♦ • 

f. BehA.v1or/d1sf1pl1ne 

Other pupil characteristics (specify): 



h 



9- 
h. 



froqraa Characteristics 



i. Curriculum ^ 

j. NaUrials •'^ • • • • • 

k. Teacher skills/knowledge 

1. Veachiog strate^l^/Dtthodologlts • • • •„ 

Teacher wtlvatlon/oorale • ^ • y ' 

n. Other teacher attitudes l^. . . v • ' 

o. Other suffing characteiris'tlcs .(e.g./ nuabers and types of ^Uff), 

p» Testlng/assessi^nt ^ • . * 

q. Record keeping ^ ♦ ,r '1 * ' 

r., Classroo* OlSan12at1on/•anagc«cn^- 

s. School organization/management • 



u. 

V. 

w. 

X* 

• y. 



Guidance serylces 

SUff/adniJilstration relations- « - ; * * 

SUff/suff relations 

School/central distrjct office rtlatlons 

School /coBwunlty relations • 

Space or facilities (school •level) . • . 

Tfme (school -lextl) • • • 

Other program ^characuVistics (specify): 



58- . 



5 



2 
2 
2 
2 



12-13,14 
15-16,17 
18-19,20 
21-22,23 



CARD «-i 
(cent.) 



2*-25,26 . 

27-28 ,-29 

30-31,32 

33-34,35 

36-37.38 

39-40,41 

42-43, a 
45-46,47 



2 


<a-49.S0 


2 


51-52:53 


2 


54.55.S< 


2 . 


57-58.59 


2 


60r^l,«2^ 


. 


63-64,6^' 


2 


66-67,68 


2 


69-70,71 


2 


71-73,74 


2 


75-76 ,7^- 


2 


78-79.80' 




CMO 5 


2 


9-10.11 


2 


12-13,14 


2 


15-16,17 


2 


W-.19,20 


2 


«-22,23 


2 


24-^,26 


2 


27-28,29 


* 

2 


30-31 ,32 


2 


33-34,35 



24. Seopt of tr>» PrtbXtit ; teiftrtlftj to school ptrlOBMl, «hit proportion oftht ichoofi pupils 



(CIRCLE CNt' RESPONSE OH EACH LIME) 



..^ 4' *v 



a. 



Pupils ^ 
T«4ch1n9 suff 



01 
Ol" 



02 



03 
03 



(A 
04 



OS 
0^ 



HINT: Questions 25 *n^16 h4ve bl-virliU rtsponse cattjorl 
rt^irded thtfl ts f1vt*po1nt scHts. A$ t rule of thieb 
and *«ort laporUnt" to Quflstlon 26. ooly If you vould 
S Q() the five-point scale. 



e^orles, ^Jrets m previously ; 
» answer "Ws* to (>jext1on 25 ; 
have 9lven the varlible e 4 or S 



Severitj , AcuriSIn^ U pcrsc,.-.*:, h th«. r'-^lea severe? 'SeverUy* Is 

TncepfScent ot *scope." In otfter worcst ffiw of tfte toul population «y be affected, 
<hou^ the prcblcff for those'^ Individuals Is very severe.) (CIRCLE 0K£) 



27. 



25. 



ERIC 



Yes <v 

Ho 

M1^s1n9 dau * . 
Confllctjng dau 



01 

00 
'^1 
-2 



26. Central ity ; According to scJiool pertonnt?, how Important Is the problem relative to other 
schoolprobleid? (CIRCLE 0«£) 



Less Inportant . 
More lapo^nt 
Hissing dau . * 
Conflicting dau 



01 
02 
-1 



YkM extensive >*ert other efforts to solve the problea during the tw ytirs prior to ROU? 
(»I0TE. Title I progr^rt count,,but only If they are mentioned specifically is efforts to solve 
the problei.) ^ (CIRCLE CKE) 



fto previous effort had been lude to solve the probli 

S<iBe previous effort had fietn Mde (e.g.. calling 
in a coeisulttnt. trying a new program) 

$ubst«At1il previous- effort had been sade (f.g.* 
InvolveiJent fn several progness) ' 

Kl«ing dau , . 

Confllctloj^U * . . ^ : * . . . . 



01 

02 

03 
-1 
-2 



How 'extensive were other efforts to solve the problea duHng ROO? (KOTE: Title I orograos 
count, but only M they are^tieittlofted specifically as efforo to solve the probleaj 
(CIRCLE OKE) - * 

Ko other effort was being Mde to solve the probln ... . » % . 01 

Sdie other effort was bel^ (t.^*. calling 

In a consulttnt, trying a new prograa) • 02 

iSubsUntlal other effort wai being Mde (e.g.. - 

1nvolve«nt In several progra«s) • . ....... * . ♦ 03 

Kissing dau , ^ . . -1 

Confllcting.dAU > . ♦ . -2 



\ 



59 



1 2 
1 2 



1 2 



1 2 



1 2 



CARD 5 
(cdlft.) 



36-37.38 
39-40.41 



42-43.44 



45-46.47 



48-49.50 



1 2 



5U52.5JJ 



V. WOBlOt lOEWTIFmTIOH PftOCESS 



I imsaMtt It My bt poJilbU to imwr s« of the -questions J" SSa • 

• If the probl» iiJentlflcitJon proctss lus not betn coiipreted. Skip thli section . 

: ontjt If the problea IdentlfJeitlon precest'lus not ytt be^un. ; 



29.^ 



In iour opinion, to *^t extent **re v^tm^of the ^lst«f ^li^K^Tsffrfe- 
fn tH Toreblw Idwtlflcitlon process^.e.. to t**t txtent did thty pirtlcipeu tn 



y Involved 



fn tH Toreblai Idwtlflcitlon process^.e.. to t**t extent did they pirtlcip 
dlscusstois. Mkii)9 oecisipns. or «rTy1»>9 out Usks reUted to the .process? 

(C»a^ (K. RESPONSE ON EACH-LIKE)^ 



UARNIKG: Tills sule Is 
different frae ntlng for* 



V 



^ 



Sup«Hnttndcnt/Asst. Supt. 
pthcr d1str1ct*1cYel suff 
Prlftcip«VAsst, Priocip*!, 
Teachtr? 

Othtr jchool-teyel suff 



01 


02 , 


03 


01 


02 


03 


01 


02. 


03 


01 


02 


,03 


01 




03 




t m 





0« 
0« 
0« 
04 
0« 



r1 
-1 
-1 
-1 
-1 



4" 

-2 
-2 
-2 
-2 



-3 
-3 
*-3 
-3 
-3 



X. 



In your opinion, how mch Influence did tny ae(^>ers of the lilted role' groups hive over 
Se^or dSclsionTln th>- E;gET5rident7yTc»tlon process? Use these definitions *s guide- 
lines for responding. ^ ^ 

Hone or very little ; H»4 little or no Input Into decisions, end little or 
no Influence. 3~ * 
iem: Nay hive lud considereble Input Into decisions* but.MS not « 
strong Influence. . 

A oreet deil: Strongly Influenced the decisions; mty h»ve fl*de the flnel ^ 
decistoflS tidrte. 

(CrSCLE ONE RESPONSE ON EACH LIKE) 




A. Sup«HnttfKjenC/Asst. Supt. 
b; Q\htr dijtrict-level suff 
c. Prifici pal/As J t. Principal 

Other ichool-ltvtlySUff 



01 


02 


03 


1 -2 


-.3 


01 


02 


03 


1 -2 


-3 


01 


02 


03 


1 -2 


-3 


01 


02 . 


03 


1 -2 


-3 


01.' 


02 " 


. 03 - 


1 hi 


-3 



■ t 



Throo9hout this lotion, inswtr -not tppliciblt' if: (0 thtrt wtrt w ^Jt of 
a E^rticuUr rolt gnw « tht sitt-for txwsplt, no ichool-lml stiff othtr thtn 
thTprificip*! AM twchtrs; or (2) It is tOQ tirly in tht proctss to inswtr tht 
qutstlon. 



10 60 



ier|c 





















# 






CARS S 






(cont.) 




1 2 


5<-55.56 




1 2 


S7-58.S9 




1 2 


60-61.62 




. 1 2 


63-6i.6S 




1 2 


66-^7.52 


m 










a 






1 






CWO 6 


1 . 














t 2 


9^10.11 




1* 2 


12-13.14 ^ 


1* 2 


15-16.17 


" 1 2 


* 18-19.20 . 


T 2 


21-22.23' ^ - 


> 


1 


1 


/ 


/ 






3K In ywy opinion, Wut w tht prtvlllng >tt1t»dt taon^ iJI 
towrSi tht local projKt during tht problf Itfentlfmtigti 
guldtllnts for rtspcod1ng« 



Mbtrs of tht luttd rolt groups 
proctss? Ufe thest crIterU is 



Aetfvt opposition ; Tikes sttps to undtrvint or ttralnatt project. Withholds 
issistinct wien rt^est«dt and aiy tven divert projtct resources to other ictlvltles* 
ProBOtes critlcisii or opposition to pn^Iect by others. If attends cettlngst expresses 
strong resenritlons about project <s i whole. 

Ptsslve opposition : Shows gnfivoreble or skei^tlcel ittltude toward project. Does 
^not protect project fro«<r1t1cs. .Gives assistance grudgingly. If attends neetlngs, 
expresses aildly negative attitude. 

Passive support : Expresses fa vorat^l e ^attitude toward project, but 'dots not Uke 
steps to assist or coordinate. Kay protect project fro« detractors* but does not 
90 beyond passive defuse. Pro«1sejs assistance but rarely or never delivers. If 
attends mtlngst does not partlc^te In discussion. 

Jjctlve support? Encourages project m>6ers to do a good Job and shows ^ cocmltnent. 
Actively responds to requests for asslsUnce or resources. Defends project before 
critics and helps to coordinate with other projects or personnel. If attends meetings, 
parti ciPites In discussion and My even lead discussion. 

(CIROE ONE f^Z^OnSt ON EACH tWE) 



a. Superlntendent/Asst. Supt. 

b. Other district-level suff 

c. Princ{pal/Asst. Principal 

d. Teichers 

e. Other school-letel sUff 



01 


02 


03 


04r 


-1 


-2 


01 


02 


03 


04 


-1 • 


-2 


01 


02 


03 


04 


-1 


-2 


01 


02 


03 


04 


-1 


-2 


01 


02 


03 


04' 


-1 


-2 



s^^^e-whole actively Involved In the problea 
. . to what extent d1d~the faculty is a Oiole participate li? 

oiscussions, caking decisions* or cirrylng out tasks related to the process? (C(RCl^ ONE) 



In your opinion, to what extent was the f>cuUy>! 
Identificatjon process— I.e. 



33. 



To little or no extent • ^ >r ' 01 

To some extent ^ . . .\ . . . ^ 02 

To a greit extent 03 

To 1 very great extent • 04 

mssing data ^ *1 

Conflicting data . -2 

Not applicable « *3 



In your opinion, how nKh influence did the ficulty as a whole have over the sijor decisions 
In the problco Identification process? (CiRCU CrtE) . 

IKPORTAKT: Use the sai« guidelines as for Question 3(h 

None or very little . . « .' 01 

Scm Ii . . . . : 02 

A great deal 03 

Missing diu ^ ^ -1 

Conflicting dau . . * *2 

Not applicable O 



1 2 
1 2 
K2 
1 2 
1 2 



CAAD 6 
(cont.) 



24-25,2ft^ 
27-28*29 
30-31 .iZ 
33-34,35 
3S*37*38" 



1 2 



39-40*41 



> 



1 2 



42U3,44 



ERIC • 



n 



61 



34. During tht problta Idtfltlf fcit^n stigtt «i thtrt a fcmuUy conitituted ^roug— other thin 
tht ftCttUy as « wtfoie^-specificany cf^Mrtd to sake decisions or cerry out tesks relited 
to problen Identlflcetloo? ^CIRCLE 0H£} 

DtWTiWT: Tht group should neet tht foUoiflTig crlCerl^ ^ 

*^ It aust heve e Ubtl (although this aay bt Infonal). \ 

- It Bust Include at iHst tic district or school staff>sj 

- It «iSt Inclodt at least one 'potential. !«pl«ntor.' 

. Yts r *r • • 01 

Ko 00 

Missing data .\ . 4 . . *1 

Canfllctlng data ' ^ ^ *2 

Hot applicable ^ ."^3^ 

. . *SXIF TO QUESTIOK 39 

35. In your oolnloor to what extent *rts this grouo actively Involved In the probleq 1dent!f1cat!on 
process«»i.e.. to itnat e^t^r.t aid Its pe-i>er$, actirm as a group s participite in discussions* 
aaking decisions, or carrying out tisks related to tfte process? (CIRaE Otit) 

To little or no ejtUnt '01 

' To vsm extent * • 02 

To a great exUnt OT 

' To a veiy great extent ^ 

Missing data ^ -1 

Conflicting data . . . ? -2 

Mot applicable -3 

36. In Y2£ Opinion, hoM jAch Influence did this group hive over the «iJor decisions In the 
probTS Identification procJssT ^(CIRCLE 0K£) 

IHPOATAKT: Use tht saB«> guidelines as for^Oitstlon 30. 

none or veiy little 01 

Sane . . . . ; 02 

♦ A great deal 03 

Missing data , -1 

Conflicting" data .\ ^. *2 

Mot applicable ^ -3 

■ ■ 
*37. On what level was this group organized and focussed during the oroblea Identif1cat<h stage? 
(CIRCLE CRET 

This school alone / . . 01 ^ 

Several schools - ^*.*02 

The district as a whole * 7 03 

- JUwthtr level ; / ' .0^ 

' Missing dau *. \ . . T -1 

Conflicting daU • '2 ^ 

Not applicable 1 . . . . ^ . . . * -3 ' 



62 

^7 



33. 



_ . ; «. . : 01 

\ V. -1 



tdMtlfictUon' suqe? (MTE: 
if keysht W4S not vtry'iCtlvtO 

Us 

Ho 

Hissing dtu . /^--v- - • • 



Conf11ctlA9 dat^ 
Kot tppllctbU ^ 



CARD 6 
(cont.) 



) 2 57*5a»S9 



39. 



wlt^To^/nd probleo^SolYlno practices? <Jj5,Hl,V!;iJ?'-^* ""^^ ' ^ 

Idear Fobles-solving •odel. {CIRa£-€K£J 



Iden tification activities congruent 
nCMranduB 



on an 



• To little or ni extent 
To soae ejftent . . % • 
To a 9rcit extent - - 
To a very grea^ exti 
Hisstns d;ti . - 
Conflicting dau 

!Not applicable"* . 



01 
02 
03 
04 
-1 
*2 
-3 



1 Z 



60*61 M 



Please -rite th4 letter (froi thi p«ora^« on an •ideal' prot)1lw-so^fi«>9 
spSJid^nrio eSh criurlin you fetl >as not ade^iteljL^t by^ the school's probleta 



spending 
identification activities. 



i 



I 



opinion. to^.t ext«t«rt the seAool's pmbim <<i'"V"^"{°" "»yrties^ tongruent 
Z arL; d«:lston.iM!:1n<i prictlces? Ust tJie cri un» jistrt *n P»rt 2 of the 



Mmrtntftn in tn ^l<te»i; prob lei-solving nxJel . (CIRCU ONE) 



To little or no extent 

Tg sooe extent ' ' ' ' 

To a great extent 

To • very gfeat extent * ' ' ' 

Missing daU 

Conflicting dau*. - - ; 

" Kot applicable - \ 

Pleise write the letter (froa the •csorandtfi on an 'Ideaf problta-splving «odel) corre- 
JSSinrw crtterlin^ fetl not ade<^uauly «et by the school's probl« 
Identification activities. 



01 
02- 
03 
04 
-1 
•2 
-3 



1 2 63*64 »65 




13 



63 



r ■ 

4K Wat 1i ^our ississnent of tht Itvtl of effort dtvote<J to, the $dteor$ problca l^gfitlflcition 
ictlvitltTKi loctl school or district ptrvirmtl? Ust thtst cHtirlt is guidtiines for 
rtspondlng. but ukt i roygh estlut^ If ntcessary. 

^}M} lew Uiw lO person-diys . , 
fJedM; 10 to 30 person-dijrl * ' . * 

Hi^ ; over 30 persocwJiys 

. ' '(ClltCU ONE) . . . / ' 

-^uii'-.../ ..-01 ' ^ 

»M{» ; ... 02 

High : 03 ♦ 

Mtsslft^ diu . . . V 

Conflicting data ^ ^ «.*2 

Kot ippHcabU *3 

VI, CHARACTtRISTICS OF THE SOLUTIOH 

42. HAS -the school cccpletcc Its sd.tjcn seltc*..cn? ^CIRCLE ONE) ^ 

Yes \ 02 

Ko. they are stllf In the process of selecting absolution . . . . Olf 

Ko* and thty are not currently engaged in solution selection. # Ooj ^ 

SKIP TO QUE 57 

'I ♦ . 

; IWWTJWT: Questions 43-46 are Intended to capture the full breadth of all solutions : 

*: planned through ROU to address the school's Identified probleas (Including an * ^ 

; problcats the school Initially defined). Theie solutions nay have included adopting ; 

; one or aore externally developed products (with perhaps soae inservice training or ; 

; local developeenul efforU tied to product iaplt^tation) txit also Hy have X 

I Included inservice treining or local deveJo(»enul efforts that were not specifically J ' 

; retated to product 1nplcc«nUtfon. t 

\ ■ 

43. HOM «ny extenulty developtd products did ttit school $tl«ct as f>»rt of Uit solutions planned 
thnw9h fm 

. JOlTCli A m»ER) . ' . • , 

- Products 5- If ;»CSt, SKIP TO QUESTION 45 ^ 

44. Of these products* how aany vere in the proJect*s original Icnowledge base (aM not Just 
added afur the school proposed to adopt^thea)? (KOTE: Answer "not applicable" if there was 
no knowledge base whett the producU ware selected.) 

(EMTER A KMER) /- ^ 

J ProducU originally in the knowledge base 

45. Old the planned solutions include any iftserviee trainirtg that was not specifically related 
to product 1ifll»enfatl0fi? (KOTE. Training In group process.* probltrt-solving. or decision 
making does not appVj«*-<hi*i^st1on* which is focused on solutions to the identified 

""problbtt). (CIRCLE OetC) 

* .Yes :. ' 0^ t 

fh .1 . . : 00 

Ml'ss1n9 data • . . •I 

Conflicting deu • : . . -2 



ERIC _ 



1 2 'es^sz^fid 



1 2 



1 2 



f 2 



1 .i 



cm 6 

tcont.) 



r 



69.70.71 



75-76.77 



78-79.80 





46 Old tht Pltnntd solgtloM Indudt »ni leetl dtvtlopwnt of ^tarlils, eurrloili, progriw, 
.tc thit w BOt SMClflcilly rtlittd to product Uplemenutlofi? (HOTI bp not depend 
SSitiS VNlS^n thTcsW Survey for your ifts*tr to this question.) {ClRaETRt) 

-Yes...' 

•HO 

Nissing dati • • • - , ^ . -1 

Conflicting dau . # 'i* ~ . -2 

|1lpOBTWarY«r'lM«rs to the rtwining questions 0« C|>»r.cttrtst1« of the solution J 
S Should describe only one^extemelly" developed product. Choose the product on ^ich « • 
h»ve the w>st diu. TTno extem»lly d*velop*d product ws selected, skip to Question ; 

:57. ^ jt 

47 . U«s tnis prodwct fn t... rSjec'.'c cr.;":l kaci^ci;- tise (eni not Just «<lded «I«r the 

pro^Sed to tlopM (NOH:' Answer "not .ppllcible" If there -it no knwledge bise 
when the product Wis selected.) (CIRCLE OWE) , ^ 

res- ' • • 01 

HO ~ 

Hissing daU ^ ' 

' Conflicting diu *^ 

Hot ippllctble • 

48. At the tiU the 'product w«s sel^ted. hid *Bp1r1cil dat* lluT^ 
through field testing? (ROTI: Assuoe the enswer Is 'yes" If the product h*d been velldetea 
«nS -no" If It h*d not,) 

Y« ^ 

Hissing daU 

^2 

Conflicting dau • 

49. Which of tht following best descrlUi the o^lgir/ IK olJefl.uSS^ 
Is btirtQ nArketed co«erclally bot you knoTTtSTs develo?«d In one of ^J^^^'^S*' 
cho^rtl^response ^Ich fits tht setting In lAlch It was developed.) (CIRCLE OWE) 

Educational research and develo(«nt 0,1 

Prattit loner. develo(»tfit/dewtstrat1 on 02 

. Conr^lal •arieting and dewlopaent 

Hlssliig dau -i * ; \ *^ 

Conflicting dau . . - - * *^ 



1 2 



1 2 



ERIC 



15 



65 



CAKO 7 



MO. It 



12-13,14 



1 2 
1 



1 2 



15-16J7 



ia-19,20 



ISO. Uhlt charicttristlcs of tM schooVs tducatlontl pfogriA Mould bt dlrtctly iffccted by 
I l«p1i»tnUt1on of this producct (NQfTC: This Itcfi rtferS onW to the direct tfffecu of 
r product 1flp1iMnUtlon**not Indirect effects or eonse<)ucaces.} 

(» EACH LBtr. EKTCR IF TOE OUftACTERISTIC WOUU> BE AFFECTED AKO A 'O- IF IT yOULD 

NOT. EKTER OKIY IF TKERE IS IKFORKATKM RELEVANT TO THIS OaESTIOtt. IH THAT CASE* 
OITER Of AU LIKES i-B.) 



i. 

fa. 
c. 
d. 
t. 

h. 
1. 

1. 

n. 



Qirriotlua. • e^-- 

KiUHiU • 

Teechlhg strite9les/ccthodolo9les .... 
Staffing (I.e.t nunbers end typei of s.Uff) 

Tettlnj/issesswit 

{(ecord icceping 

Clessrocfl orQinlutlon/junigenent 
School orginlutlon/una^eaient 
Guldince services 
Coffincr*«t1on s:n;ctvPti/!;ST 
Ut« or ivi/ltbllfty oMp^ce or ficllltles 
Us* or avtlUblllty of tl 
Other (pitut specify): 




2 
Z 
2 
2 
2 
2 
2 
2 
2 
2 
2 
.2 

2 
2 



CARO 7 
(cont.) 

21-22.23 
24.25.26 
27-28 ,29 

33-34,35 
36-37.38 
39-40.41 
42-43.44 
45-46.47 
48-49.50 
51-52.53 
54-55.56 

57-58.59 
60-61.62 



51. 



In yoor opinion, Wut Is ttic decree of nerlt or rtlitlvc idvinugt of this product ovtr 
existing pr»etlcts7- (CIRCLE'OHE) 



UARHING; .This scile Is 
different Tron rating form* 



No. a 



01 



Very little ^inuge 02 

Scm idvinUge 4 ' ^ 

A greit idvintege ^...^ ^ 04 

A very greet tdvintege ' » . . . . OS^ 

msslna date ...... ^. % , -1 

Conflicting data^ -2 

■ 

SZ, in ypur opinion, did this product-* prior to any aajor nodlflcatloos-^cutch the Probloi 1 
wsTntendtd to «ddress*-as this problee was originally defined? (CIRCLE 0^0 

Tti , . : .V . . . ^ 01 

No : 00 

Hissing dau / -1 



-1- 2 



1 2 



Conflicting diU 



63-64.65 



66-^.68 



53. 



ts th* product designed to affect pupils dlrwtly (and not aerely to change adalnlstratlve 
procedures, for exanple)? (CIRaE OKC) 

ys . , 01 , 

Her .' 00 

Hissing data , -1 

Conflicting dau ' -2 



1 2 



69-70.71 



ERIC 



16 66 ' 



. ' ■ - --I , 



54. Dots tht product consist of P>rts> or ibdul^ , thu could be used sepirittlyr (ClRCtE ONE) 

\ . : . . . , 01 . ' 

. , , • ; • , • • • 00 

-1 



• Yts 

, , No * . . 

^Hissing, diU . . 
Conflicting daU 



55. In your opinion, 1$ the product Cdclex? («3TE: •CcoplexTtjr^^tfers to the wbtr of ^ 
thlngr'thit m%t be ch«n9ed/iddrtssed/coordl)ruted In order to lo^enent the product,) 
(CIRCLE ONE) 



yes 

No 

Hlsslng^diU • • 
Conflicting daU 



56* In your opinion, how eisy would It be to rr 
tisTTy could the school return to Its prior 
s Pore that 1i * 
Iff firings a 
sute.) (CIRCLE ONE) 



WARNING: This scale Is 
different fron rating fom. 



Very dlfflQilt to irtverse . j 
Difficult to reverse .... 

Easy to reverse 

\ei7 easy to reverse .... 

Hissing daU ........ 

Conflicting daU 




.1. 



. 01 
. 00 

. -1 



erse irglcnenUtioo of this pr«duct-''1 *e., 

— - . - ■-- sute tf the product ii not penninently idopted? 

(Sote' 'ihe'wre that impleoeiiution of i prtduet involves Jubitanti»1 iirevcriible ch»ngei. 
luch IS lUff firingi or new fteilitiei. th<! greeter the difficulty of returning tQ « prior 



01 

•02 
, 03 
, 04 
, -1 
. -2. 



ERIC 



67 



17 



1 2 



72-75,74 



1 Z 



1 2 



CARD 7 
(cont.) 



75-76,77 



78-79.80 



S7* 



V 58. 



J DKWrw^ It My bt posslblt to ins^r soi» of tht questions In this stctloti tvtn * 
i if tH-solutlon stlfctlon proctss h4S not b€«n coopUteii. Skip this section only * 



If tM solution selection process has not yet bc^. 



In your ooinlortt to iih*t extent ^rt any tofeers of tht listed role. groups tctlvtly fnvolved 
In tKT tolutlon selection prt>cess^l.t.« to *A|t txunt did they pertlclpeu tn discussions* 
mkfng^ decisions* or cinrylng out tasks related to the process? ; 



(CIRCLE OKE RCSPOrCC ON EACH LIKE) 



WQiim: ^Thfs scale Is 
dlfferent^fm rating foni. 



c. 
d. 



Superinttndent/Asst. 5upt« 
Other dlstffct^ltvti suff 
PrfnclpaVAsst. Princip^C^^N- 
Teachers ^ 
Other school -ievtl sUff 



01 


02. 




04 


-t 


-2 


-3 


1 


2 


01 


02 


' 03 


04 


-1 


-2 


• -3' 


1 


2 


01 


02 


03 


04 


-1 


-2 


•-3 


1 


2 


01 


02 


03 


04 


-1 


-2 


. '3 


1 


2 


01 


02. 


03 • 


04 


-1 




-3 


1 


2 



Iif your oplnf bh« hon auch Influence did an^ i«C!bers of the listed role groups have over th« 
•iJorJeclsloftS In tht solution stltctlon process? (fWTE: An Individual or group wy have 
had a'strong Influence even If producu mrt screened prior to their Involvement, provided 
they Mtrt presented with a rtasonable nunbtr of alternatives. ) Use these definitions as 
Qul^llnes for responding. . • "f ^ ' . 



Wont or very little ; 
no influence. • 



Had little "ho Input Into decisions* and little or 



Sqae: ' ftay have had considerable Inpvt Into decisions* but was not a 
strong Influence. ^ 

A qrf*t deal ; 'Strongly Influenced the decisions; may havt «ade the 
final decisions alone. 



(CIRCLE 0K£ RESPONSE ON EACH LIKE) 



a. 
b. 
c. 
d. 
e. 



4jperlntenden 



^4* 

^ ^ if* • 



Superlntehdent/Asst. Supt. 
Other dUtrlct-ltyel.sUff 
Principal /Asst. Principal 
Teachers 

Other school *level staff 



01 


02 


03 


-1 


-2 


• 01 


02 


03 


-1 


-2 


• 01 


02 




-1 


-2 


01 


02 


03 


.-1 


-2 


.'jOl 


02 


03 




-2 



ERIC 



• Throughout this section* anti*er "not applicable* if* (1) there were no netibers of 
a particular role g^ at tht liU; or (2) It is tbo early In the process to ans^r 
tht question. ' ^ ^ 



* • 

. 68 e. 



1 2 

1 2 

1 2 

1 2 

1 2 



•CARD 8 



9-W.11 ' 
12-13.U 
15-16.17 ^ 
18-1 9.2d." 
21-22.23 



24-25.26 
27-28.29 
30-31.32 
33-34.35 
36-37 .3a 



^S»* In XSiL Opirttoo* «h4t tht t»»v*11lrwi tttitude W)ng til eeabers of the listed role 
groupt tOMtrds the loeal itrolect^rlnq tftc sotution lelection process? UHf these 
crIUfie is guldellnes for resppodlngL- ^ . ^ ' 

Ae irt opposition: Ttkes-sttps to undermine jor ttminate project. Withhold 
Kikstince when rtQue$ttd« end s4y even*divert project^rtsources to other 
ectlvltlts. Promotes critlcis* or opposition to project by others. If 
attends iMtin;sC expfesses strong reservations about project as a wtiolt . 

Passive opposition : Shows unfavorable or skeptical attitude towarjl project. 
Dots not protect project froB critics* Gives assisUnce grudgingly. If 
attends aieetfiigs, expresses alldly negative attitude. 

Passive support : Dpresscs favorable ittitude toward pro^^t, b^t.does not 
take step^ to assist or coordinate, tiay protect project from detractors, t)ut 
* does not 90 beyond passive defense. Pronises assistance tnjt rarely or never 
delivers. If Attends stings, does not par.ticipate' in^iscussion. « 

. Active support : Encourages project Acebers to do a goo4 Job and shows oim 
ccQaltMntrKctVvely responds to requests for assistance or resources, 
befends project before critics and helps to ^ordinate with other projects 
or personnel. If attends mtinos* participates in discussion anjl^y even 
le|d dlscu^sicr.. , 




11 



tClitCLE ONE RESPONSE OtC ZKH lIkE) 



^7 



/ 



e. 

b. 

e. 



SuperinUndent/Asst. Supt* 
Other distHct-^level staff 
Princlpal/Asst. Principal 
Teachers 

Other school-level staf^' 



01 


02 


03 


' 04 


*1 


-2 


-3 


01 


02' 


03 


04 


*1 

* 


< 


-3 


01 


02 


03 


04 


-1 




•3 


01 


02' 


03 


04 


-1 


-2 


-3 


01 


02 


Q3 


04 


-1 


-2 


-3 



To little or no*extent 
To scm extent ... * 



60. lo* your opinion, to what extent was the faculty as a whole actively involved in the 
solution selection process— i.e., to what e^jtent did the faculty is 1 irfiqle participate 
In discussions, naking decisions, or carrying out Usks related* to the process? 
(ClRCtt,OKE) ^ * 

, , . 01 

02 ■ 

Ta a great extent . ^ 03 ^ 

To a very gr^aTextent • ^ .'^ 04 

— Hissing .data / . 4. ; 

Conflicting daU -2 

Kot applicable 

» * 

61. In your opinion, how iwch influence d)d the ^<culxy as a whole h»ve over the naior 
decTTions in the solution selection process? (CIRCLE OtiL) 

. IMPORTWIT:^ Use the- sace guidelines as for Question" 58. ^ 

Hone or, very little ^ 

SiMt. r . ^ . 

A (pit deal .... 

Kissing dati ^ 

, Cpnflkting^U . . . . 

Wt applicable • . - - • ^ . 



01 

0? 
03 
-1 
-2 
•3 



ERLC 



(S3 



1 2 

1 2 
1 2 



1 2 



T 2 



CARD a I 
(cont. ) 



39-40.41 
42*43,44 
45-46,47 
48-49,50 
S1-S2.S3 



54-55 «S6 



S7-Se«59 



A 



rtUttd to solution >tl«t1on? (CIRCLE 0«E) . . * . * 

WPOOTMT: Thf group should awt'tht folloi-ing criUrU: ^ 
• It «ist Avt 1 1«t*1 (tlttwugrf thli «y be Info^ 



• It Hist Includt 4^ Uiit two district, or school staff. 
It nrtt iftcludt it lust^ont "pottntitl iop1e»enlor. 



YtS - 

Ho V 

Hissing dtu * . 
Conflicting UU 
Not ippliciblt • 



4 



01 
00 

-1 

-3 



1 2 



? TO QUESTION 68 



63. HOW ii*ny iwb«rs of the groiip you described in Section Y were «1soi«ePber$ of this grwjpT 

. " : 01 



None " 

Few (less thin Z0%) % . . T 
S<M (20-45t) . • 
A Urge proportion (50*79t) 
AU or ttjst (over SOX) . . . 

mssing diti - - 

Xonflicting date 

Not ;tpplicable * 



02 
03 
04 
OS 
-1 
•2 
-3 



k64. 



In xaiL opinion* to A^t extent wes this group ictiv£lx InYOWtd ^^^^ Jgl^^?" dilcSil^on i 
proS«?M.e..^ what extent did iu •eabers, att^nq as a <"^Pvp^f^^5^P;^ ^" discissions, 
S^nr»e1^^> or.^rrying out Usks reUted to the process/ (CIRaE ONE) 



To little or no exUnt 
To sane extent .... 
to 4 great exUnt . . 
fo a very great extent 
mssing daO ..... 
Conflicting data . * . 
Hot applicable ... * 



01 
02 
03 
04 
-1 
-2 
-3 



te. In your Ipinloa. how wch Hlsencc did tfTis group have over the «ajor dKislonj In the 

• solution selKtion pry^ssnnm OWE) ^ 

• ' ■ 

-flWawiT: use the site guidelines as for (Xjestion 58. 



None or very little 
"SOi* V 

A great deal . . 

Hissing dau . • - 
-Conflidting dau^ . 

Not applicable . 



. 01 
. 02 
.v03 
. -1 
. -2 
. 



ERLC 



^ 20 



70 



1 2 



1 2 



1 2 



CARD 8 r 
(cont.)[ 



50-ei ,62 



63*64,65 



66-^,63 




66.^ On Wwt Itvtl this group orginlzeS ind focused during the solution selection stige?^ 
(ciim WET 

This school Alone «^ 1 ' of 

Sevtrtl schools . . . T • ^02 

Tht,d1str1ct 4s k whole 03 " 

Another level • ^ ^ * • * • . 04 . 

^ . Hissing dtti ) 

Conflicting dati ^ « « . « * •2 

Hot ippllcible . * • -3 

57* Ites the principal or otheKschool idalnlstretor i reober of this group during the solution 
selection suge? (HOT£; Answer 'yes* If he/she et least nom1nill> e i«eber« even if 
he/she wis not very acttve.) (CIRCLE Or<E) 

^Yes *. • .f 04^ 

No ' 00 

' Hissing data % ; *1 

Conflicting date . ♦ ♦ ♦ - -2 

5ot ippllctble ^ ^ f -3 

■ 

m 

68. In your opinion, to whit extent were the school's solution selection ictlvltles congruent 
witlisobnd probleo-soMngj prictlces? Use the crt ten I, listed in nirt 1 of the oemor^ndua 
on in 'Ideal' prob1e»*soly1ng todeK (CIRCLE Wi) 

To little or no extent,.,. . • 01 * 

To sopoe exUnt * 02^ 

To I great extent 03-^ 

To a very great extent . 04 

Hissing data ^ *^ 

• Conflicting daU ^2 

> H ti ifp U cable .* -3 

Please wrlU the letter (fre« the nessorindu* on an "Idear problea-solving codel) 
corresponding to eich criterion you feel was not adequiUly aet by the school's 
solution selection activities. 

- * - 

69. In your opinion^ to wKat exUnt were the schooVs solution selection activities congruent 
with sound <>roup decfstonHMklno practices? the criteria listed In Part 2 of the 
iMorandM on an "Ideal" problem-solving nodel . (CIRaE^ 0K£) 

To little or no exUnt -? 01 

ft 

To sovte extent ^ .". • 02 

To a greats extent ^ 03 . 

To a veiy great exUnt 04 

' ' Hissing daU ' 

' Conflicting daU \ ..... . . 

, Hot appl1c4ble : ^' .' -3^ ' , 

Please j^rlu the letUr (fro* the ©eforindum-on in •Idtir proble*i-solvlng oodel) 
Corresponding to eich criterion you feel wis not idequitely set by the schooVs solution 
selection activities. 



ERIC 



7X- 



21 



70 Witt 1$ yoor*t$$t$$i«nt of the 1ml of tf fort divotid to the school's solution selection 
itftlvitieTSy loc») school or district peno/inel?^ Use these crlterit a$ 5ulaeuneJ tor 
responding, but Mke t rough esti^e \f necesseryi 

low: less ibin 10 per^on^dtys \ ' ^ 

HedUffifc. W to 30 per$0As*days | ^ ^ * 

High: over 30'per$0ft-de>s I ' 

" ■ (CIRCLE OHE) ^ , ^ ' 



Low . . 
Hedlun 



Hissing diu . . 
CbofHctlng diU 
N^f apc^fcable . 



01^ 

02 

03 

•1 

-2 

-3 



VIII- 



PROOUa IKPIEHEKTATION FACTOftS AhD OUTCOMES 

» tiai>tt f *V***** ******** 



I IHPORTAHT: Your tsswers to these questions on product lepleaentttlOT factors end 
: ogtcc»es shouia contlmje to focus on the one product referred to In Questions 47-56 
; ibove. If no extemelly developed product ws selected, skip to Question lU. 

• ^ * a ******************* ****** 



71, 



Is the product cur^entl^ being used «t the school-1-e.. « of the tlcs^ of the oost recently 
eveilible ^Inforaatlon, w« It bciig used? (CIRCLE WtE) * 

- 



fes- 



.v- 03 



Ko. they ere still planning for loplwenutlon 02 

Hot plens^ to use the product were abandon ej[ % fore 1nples«nUt1on , , . . 01 

SKIP TO QUESTIOW 86 

..... po ^ 

SKIP TO Q0£STI&N^77 

4 



Ho, use of tM product ws disiontlwtd tftef Impleeientitlon 



72; Vhat propornon of tht p«pils «nd SUff ijffectel by the ^roblea ire dlreetl/ Involved In use 



It 
1 



Of the product? 
(CIRCLE ONE RESPOKSE ON EACH ^IKE) 



/ / -V 



01 

or 



A/ 



73- 



a. Ruplls 

b. Teaching sUff 

\ 

How often Is the product used? (CIRCLE ONE) 
''One t1«« Ortly (e.j.. «n Inservlce progria) 



02 
02 



03 
03 



04 
04 



05 
05 



■ERIC 



Cess thin once t •opth. but on «.cofttlmiing b*s1s 

At le«st once t "onth ,■ • ■ 

At le*st Ortce * week V " " 

0«lly or ell the tine 

Missing d*u 

•C^fllctin^ <uu • 



-1 
-1 



01 
02 
03 
04 

-1 



-2 
•2 



72 



\ 2 



U2 




1 2 
1 2 



1 2 



CARD 9 ■ 
(cont.); 



12- 13,14 



16-19.20 
21-22.23 



24>2S.26 



*41rtct1y (CIROC 0K£) ' . 



75, 



76. 



77. 



ERIC 



Ltss thm 2M . . 
«K4« i • • • • 

50-79S 

80S or «ort . . , 
Missing d4U . . 
Conflicting diU 



. . 01 
\ 01 
. . 03 
, . 04 
. . -1 



Hot «ppHc«bl«, pupils are not ttlrectljr Involved ^3 — —r^ 

. S«P TO C3UESTI0H 76 " 

* o J 

I 

Approxlf^ttly ho*< ;MfV hours (plu$*iSlt1ooil alnutcs) In « typVoJ «r« iffecte<l by th^ 
utt of product, for pupils «re directly Involved? 

(CKTER Kl«£RS) ^ ♦ 



Is tne product being used fr^ •ore-tJufl one school In the district is i result of «0U? 
INOTE. A VW" tnsw^ does not flecessirlly Juply thit other schools were iBiple««nt1n9 the 
prodttct under the WXI legis. It wy InsUid Indicate natural diffusion* or spread J 
(CIRCLE ONE) 



Yes 
No 



Hissing daU 



; ; ; - - ; 

Coofllc^ng daU - *^ 

Hot*ippl1cable. the product Is not used within schools . ^ -3 



fn your opinion, to w*ut extent was the developer's original deslgK of the producrt ued^fled 
befoFTand after 1iiple»enutt?n7 (NOTE; A product wy be «od1f1ed)by adding to. delating, 
Chang inGt oFeTaboratino upon the oHginal product objectives and Allosophy, perfortince 
re<?u1rtsnents (e.g.. -^ate^ialSt content. se<?;tnc1ng. InUnded treatAtttjj^fEJ'j^ 
i*nt. length of exposure, ^teaching techniques, etc J. wnagenent charactefTstlcs 



administrative support, s 
cents. etcj» oi training 

(CIRCLE "OKE RESPOKSE OH 




clissrocii.oi^inlzatlon. suffin? or Itidership/ 

Its.) . - ^ 



■r 



%^ atfort laplcxenutlon 
b. 'Afttr lnpleetflUtlon 



01 
01 



r 

02 
02 



OS 
03 



04, 



-1 
-1 



-2 
-2 



If ttit product MS aodlfled to lUtle or no txtent 



BtrORE WPLDCWTATIOK 
AFTER IHPLOWflATIOC 



SKIP QUCSTtOM 78 
-> SKIP CMCSTION 79 



1 z 



1 2 



1 2 



) 2 



CARD 9 
(cont.) 



27«28.29 



30-31 , 
32-33,34 



35-36.37 



38-39,40 
41-42,43 



7i.^ Uh4t Mtrt tbt msons for thf nodtff cations that Mtrt nadt btfore lisplesienUtlon? ^ 

(CM EACH LIKE* OfTER A IF \HI R£A50et APPLIES ANO A 'O- IF IT DOES NOT. EHTER ^-r OfllY 
IF THERE IS hO IKFORMATIOH «L£VANT TO THIS (jgESTIOH. IN THAT CASE, ENTER ON AU 
LIKES a-c.) 

A To accomdau tht prtj<Juct to txixting coft^«tion$ (e*9-t cyrrlculuo, 
■attrlilSt approaches* phflosopny* sUfflng* organization* space or 
facilities* MqtVi^ tic.) . / • • * 

b. To li^rove the effectiveness of the product In the local context 

(9lvt« pupil or sUff characteristics* for txaople) / 

c. To* li^rovt tht inherent efftctlycness of the product . . 

79, What litre tht reasons for the nodlffcatlons that wtreWtle after lapleatnUtlon? 

(ON EACH LIKE. ENTER A T IF TKE REASON APPLIES AND A 'O* IF IT DOES NOT. ENTER "-1" ONLT 
If THERE .IS NO IKfORKATION RELEVANT TO THIS QUESTION. IN THAT CASE* ENTER -*r CM AU 
. LIKES a-i.) ^ 

a To acc*^*^ ^ proouct to exist1n9 conditions (e.9^* curricylwa, 
■ateiVals* approaches, philosophy* staffing, organization, space or 
.4 faclimi** budgets* etc J 

b. To liprove the effectiveness of the product In the local context ^ 
(given pupil or suff chara^terktlcs* for exanpje) 

c. To laprove the Inhertnt effectiveness of the product 

80- Accordino to school personnel* to *<hat exunt was ade<yjau gu idance for 1ople»ent1nQ the 
product provided >y the developers* either In writing or througn training and technical 
ass1sUn(re? (CIRCU ONE) ^ " 

To little Of* no exUnt ' ' 

To sa>« extent ; 

To a great extent ^ / 03 . 

To a very great extent ^ 

Misslhg daU 1 . . . \ -1 

Conflicting daU '2 

»1. Accord1n9 to school personnel* to what exUnt was the product difficult to lEsplecaeat? 
• (CIRCLE ONE) * • ' * ^ 

TO little Of no,exUnt - • . * , 

To sooe extent ; ^ 

To a great extent 03 ^ 

To a very great exUnt . . . ^ • r ^ 

Kissing daU • 

Conflicting daU ^ . . . ; . ' *2 



if 



± 



24 



74- 



1 z 

1 z 
1 z 



1 z 

1 z 
^2 



1 z 



1 z 



CARD 9 
(cont: ) 



44-45*4S 

47-45.49 
50-51 *&2 



53^4,55 

56-57,58' 
59*60,61 



62-63*64^ 



65*66*67 



5« 



m 



n. In lovr oylnlM. W«t irt tht >rtvllHft9 <^trrniX it«t»d« t»* following jniMp* town! 
^ tl» product that Mt diosMT 



(ClltCU OKf'uSKKSEjtM CACH LIHC) 



a. Suptrlnttfldmt/Asst. Supt. 

b. Other d1$tr1ct*livtl staff 

c. Pr1nclp«l/Ai$t. Principal.. 

d. Teaclwrs Involvtd In ROU 
c. Unldcfltlfltd 



4 

01 
01 
. 01 
01 
01 



02 
02 
02 
02 
02 



03 
OJ 

03 
03 



04, i 
04 
.04 
04 
04 



05 

,05 
05 





-4r 






-2 


•3 




^2 


-3 




-2 


-3 , 




-2 


-3 


*1 


*2 


-3 



I 2 
1 2 

II 2 
ll 2 

1 2 



CARD 10 

9*10^1 

12-13J4 

15-16.17 

18-19.20 

21-22.23 



&3. 



64. 



Kivt fonul plans for tvaluaClon and fM<!back on this product been drawn up? (NQTH* A 
fortial plan should specify it least the following, who will be responsible, what success 
criteria wlli be vse<*, nvi hov c^U w^«t &e gatte^-ec. it snouid also be a 1ittU«ore iomal 
than^saying Uachcrs wilt react verbally, for example.) (CIRCLE 0H£) 



Yes^ 

ko 

Hissing dau * * 
Conflicting daU 



01 
00^ 



SKIP TO QUESTION 85 



To what extMit have the foraal plans for evaluation and feedback been Itpleeented? 
Hot at all 



Sow, but not all, parts appropriate to this point In tlee 

hive been lapleaented 

All parts approprlau to this point In tine have been iBplcxenttd 

WssJt)5 daU • 

Conflicting data * 



02 
03 
-1 
-2 



1 2 



1 2 



24*25.26 



27-28.29 



85. Over the next few years, which of the followinj possibilities do you think "Ojt ^J^ely to 
happen with respect to the use of the product wng Uachers at trtis school? tClftat OKE) 



The 'product will b% dropped, or his alrtfdy been iUvf^ 

Sane or all of the Uachers will use the product. 

but not extensively . • 

Soae or ill of the uachers wtll use the product. 

and It generally will be used quite extensively « * . . 

Missing daU . . • • i*. . . . ; • 

Conflicting dau 



01 

02 

03 
-1 
-2 



1 2 



30-31 .32 



2S 



75 



( 




IX. PtAWmC POft ItfLOgMTATIW PROCESS 



86. 



87 



ERLC 



1 



• «ii9<ttTiifT* It uv DMslbIt to answer sooc of the questions In this section even i 
S !?S%t«1% ferWe^nut^^^^^ h.s not beS cwjeted. Skip this section : 

• only If the plAnning for lBple«nut1on process his not yet b«un. ^ • 




In y o o r opinion, to 
In the Dlirwtnq for 
d t scusslons^ Mining 

(CIRCLE 0«£ R£SPOKSE OH EACH LIKE) \^ - / 



tny Holders of the listed role groups letlvely Involved 
rocess-I.e*. to **nat extent did they pirtuipite tn 



were 

i process*- — - , 

carrying ouTUsks related to the process? 

% 



IvAftNlHG: This scale 

• different frca rating fonn. 

' 



V 



<5 



/ 



55- 



CI 


02 


03 


04 


-1 


*2 


.3 


01 


02 


03 


04 


-r 




-3 


01 


02 


03 


04 


*i 


-2 


-3 


01 


02 


03 


04 ^ 


-1 


-2 


-3 


01 


02 


03 


J)4 * 


*i 




-3 



a. Superintendent/ Asst. Supt. ' 

b. Ojber dlstrlct^level sttff 

c. PrlnctHiaJ/Asst. Principal 

d. Teachers 

t. Other school -level sttff 

In your opIftlofY. how wch Influence .did afa^^ecOers of the listed role ^rwps have over the 
iSjoF7ec1s1c« Ma iming lor t»^l«Shtatton process? Use these definitions is guide- 

lines for responding. ^ 

ttene or very little; Kid little or no Input Into decisions, ind little or 
no influence. J , 

Soac; Kiy have had cooslderible Input Ir^to decisions, but wis not i i 
g strong Influence. 

A great deil/ " Strongly Influenced the decisions; wy have wde the final 
decisions lione. 

(CmE OME RESPOftSE OM EACH LIKE) 



/ 

''■S*^ 



«. SuptrlntendentyAsst. Supt. 

b. Other dlstrlct-Uvtl suff 

c. Mnc1p*l/As»t. Prlnelp*! 

d. Ttactwn 

«. OtlJtr jchool-ltvel suff 



01 

91- 

01, 

01 

01 



02 
02 
02 

o'z 



.03 
03 
03 
03 
03 



-2 
•2 
-2 



-3 
-3 
-3 
*-3 
-3 



• T)>rou<ihout this SKtlon, »n$iier 'not »ppl1«blt' If: (1) thert were no nwiers of 
rSrtlaihr rtltlnw this sltt; or (2) U 1$ too t»rly In the process to 
eniwtr the (piestlon. — ■ 



76 • 



]fi yoor opinlpn, W»tt w tht fim*1Hnq tttitwit ucun? *!! cMibttOf tht llstttf rolf 
groups toirtrts ttm loctl proitct tfurtno tht pulmInQ for l^icg^nUtion process? Vsf 
tJits« Cfiuft* «S Stiidtllnn for ftsponding* ' 

Active ccootitioa : Takes sups to untfmine.or umlnete project* ^<ltnho1tfs 
esstst4Ace wvto revested, end Ny even divert project resources to other , ^- 
Activities*- froiNotes criticise j>r opposition to project by tfthers. If ettends 
mtinsSi expresses strong reservitions about project ^es e Oiole, 

Passive opposition : Shows unfevorable or sUpticer«ttitude townS project. 
Goes not protect project froii critics, Cives assisUnce grudgin9ly/» If attends 
mtingst expresses aildly negative attitude* k . 

Passive stfpport; Ixpresset favofable altitude toward proiect»^t does not 
me steps to assist or coordinate, Kay protect project fron detractors* but^ 
4oes not 90 beyond passive defense. ProQises assistance but rarely or never 
ittlivers* If attends i«etings, does not participate in discussion* 

Active support: Encourages project aenbers to do a goo^-job and shows ^ 
ccMiitaent* Actively responds to requesU for assisunce or resources* Defends 
project before ciHtics and helps to coordinate with other projecu or personnel. 
If attends meetings* participates in discussion and Ny even lead discussion. 



\ 



a// 



V 



SuptrlnUndent/Asst. Supt. 
OthCr'tfistrlct'ltve/ suff 
Prlftci^l/Asst.. Prirkitxl 



b, 

t 

^C, 

d, 'Teachers ^ 
e! Other school-level SUff 



01 


02 


03 


04 


-1 


-2 


•3 


1 


2 


01 


02 


03 


04 


^ -1 


-2 


-3 


1 


2 


01 


02 


03 


04 


•1 


-2 


-3 


1 


2 


di 


02 


03 


04 


-1 


-2 


■ -3 


1 


2 


01 


02 


03* 


- 04- 


-1 


•2 


-3 


1 


2> 



89. 



In your opinion^to what extent was the faculty -is a whole actively involved in the planning 
for iic1ej>enuti6n processf i>t., to what extent did the ficulty as a whole participate 1*, 



discussions , ^ic|ngJecisionSj,_^^^ UJbt^ process^ JJlfl^Clt Wf> 

, , , , , 01 

, 02 

03 

(tent « * * * 



To little or no 
, Ta sotte extent 
To a great extenf^ 
To a very great 
Hissing dat^* * 
Conflicting dau 
Not applicable . 




90. 



In ygu r opinion, how nuch influence did the faculty as a w^ 
in tSe planning for japleynutton process? (ClRCCnSflEy 

'iMPORTAKT; ^Use the sacie guidelines as for Question 87, 



04 

-1 
•2 
•3 



as a whole have over the wjor decisions 



Hone or very Httle 

Soae 

A great deal *; *' * 
Kissing daU * * * 



01 
02 
03 
-1 



Conflicting dau * * * * J , , * * *^* * * * -2' 

Not appHcable A - ^3 



H-ERJC- 



77 



1 2 



1 2 



CARD 10 
(cont*) 



63*64*65 
66*67«68 
69-70,71 
72-75.74 
76-76,77 



78-79,80 



jCA^ 11 



9-lOjl 



91. 



Durlna the pUming for iwplentnUtlen tuge. MS thtre t fcrsalty coflstltuted gwt-other, 
th»ft tht faculty «s » t<ho1c~specif{cttty eapewerrt to Mkt decisions or c»rry out t»sks 
nUtti to pltnnlng for liiplmnutlonT (CIItaE ONE), 

IWOftTWCT: Tht ^rogp should «it tht following crtterlt: 

- It HiSt h*vt 4 libfl («lthoo9h this «y bt infonttlK 

- It iDcltfde it letst two district or school sUff* 

. It «i$t iDcWe tt Itist one "poftnti*! iaplooentor," \ 



Yes * 

No 

mssii>9 dati * " 
Conflicting 6mU 
Not applicant , 



01 
00 

-1 

-3 



i 



Skip to ooestion 97 



92 How wbers of tftt 9rvi*p you describee *ln Sfctton Vll were ilso c»ecl«rs of this groups 
(CIRCLE OKE) ' . ' 



None .1 

Few (less trun 20X) 

Sm (20-4?X) 

A Urge proportion (50-795), 
All or nost (over 80t) , , . 
mssing dm . • /I . . • - 

Conflicting daU • 

Not applicable 



01 
.02 



03 
04 
05 
-1 
-2 
-3 



93. 



In tour opinion, to what extt^it was this group actively involved in th e planning^for 

in discussions, Baking decisions, or carrying out Usks relatedto the process? 
(CIRCLE ONE) 



To little or no extent . 
To sone extent , , ^ • 
To a great extent . 
To a very great extent 

mssing daU 

C^f) feting data * * • 
Not applicable .... 



01 
02 
03 
04 
-1 
-2 
-3* 



94. In voir opinion^ hoK wch influence did this group have over yie Rajof^decisions in the • 
DlannTno for ipplcaentation process? (CIRCLE ONE) 

IMPORTMT: Use the sm guidelines as for (X*estion 87. 



None or very little 

Sane - 

A great deal * • • 
Hissing dau • • • 
Conflicting daU . 
Not applicable • • 



01 
02 
03 
•1 
-2 
•3 



/ 



28 




95. 



» 96. 



On «i\«t Uvtl was thtt 9roup orginlttd tnd focus during tht plinnlng for 1»o1etncflUt1on 
St>9*? •'TCT^ttE 0K£) 

This scKool tloi*t\ . . . . . . ^- ' 

Stvtrtl schools - . - . 1 • • - . ♦ - 02 

Tht district iS « *hblf - - . / 

% AAoth«r 1ml ^ 

'wssing (UU , . . « • -1 

Conflicting diti " ' 

Hot •pplictble * . . -3 

Uas the principal or other schoof 4«n1strator « waber of this group during, th^ plinnlng for 
tepleaenutW stage? (NOTE- M^r "yes" If he/she was at least finally * ^Hfititr, even if 
he/she was not very active.) (CIRCLE OKE) 



Yes 

ho ..... 
Missing data . . 
Conflicting dau 
itot applicable . 



01 

00 

-1 

•2 
-3 



97. 



In your opinion, to what extent were iJte school's oUnnlno for 1t5p1e<nentat1on activities 
congFSent witb souftd pcoblet>*solv1nQ practices? Use the criteria listed in part 1 of the 
maorandun on an 'Idea*"" prt>t>»«»-S0lv1ng «p<iel. (CIRCLE OKE) 



To little or no extent 
To soffie extent . . . - 
To a great extent * . 
To a very great extent 
Hissing daU... . / 
Con fl tc t tng Aa ta^r^rr 
Not applicable .... 



01 
02 
03 
04 
-1 



Please write the letUr (froi the tcwrawlt^on an 'Ideal' problen-solvlng wodel) corre- 
sponding to each cflUrloo you fe«l was not ade<?uaUly oet by the school s. planning for 
liBplefBeiUUtlOn activities. ^ 



Sa. In your opinion* to what exttflt wert the school's planning for Igplcfoentatlon activities 
congnJent with sot«d group decision-making practices? Use the criteria listed In Part z 
of the nmraDdux on an 'ideal* problC9*solv1ng nodel. (CIRCLE ONE) 

To little or no extent • 

To so« extent * ■ ' ^ 

To a great extent * . 1 

To a very great ext^t ^ 

Hissing d#U ^^^.n-w^.* - ' " - , ■ ' 

^ Conflicting daU ^. \» -2 

9ot applicable . 

Plea« wHU the tetUr (frcw the m)randt«i on an -Idear problea-solving eodel) corre- 
sponding to each criUrlon yo« fetl was not ade<»uauly net the school s planning for 
lff)l<«ttflUt1on actlvUlti. \ I 



ERIC 



29 79^ 



1 2 



1 2 

\ 
1 2 



ca;^ 11 

(cont) 



24-25.26 



27-28*29 



30-31 .32 



1 2 



33-34,35 



< 



UhAt U your tssesmflt of th« Igvtl of tf fort dtvottd to the ichool's pUnnlno for 
Kl J t^ tHTon rnM byl octl school or j litr4ct ptirsonntl? Ust tneie crUeru ts^ 
9vl0tHnts for rt$po«<11n9» twt wke t rough eitlwU If ntceiiiry- 



, Imz Us$ thjn 10 ptr«on-<Uys 
^ KtdiM: 10 to 30 ptrii^n^ys 
High: ovtr 30 ptrion-^Iy^' 

(CIRCU ONE) ^ ; 



Low 

Ktdlw . . . . * 

High 

Missing ^lU . . 
Conflicting d«U 
tiot appllcible . 



1" 



• • • • 



01 
02 
03 
-1 
-2 
-3 



g. -IMPLOgMTATlOW PROCESS 



i IHPOWm: If the pro<J«ct h« not ytf be*n luplcnenttd* skip to Question V14- 






: I>«W7AKT: Tht types of activities to consider as part of ^l^/^'^^IEff^^tJlSIl ^^t^^'^ 
Z InMwnltorlng. tvaluitloo, a<to1n1strat1on. coordination, and group discuss lon-not 
2 actual use or iBplciaentatlon of the product. 



100- In 33ir opinion, to «tent ini ^rs of the "»ted role grw^s «yely Inv^ 
4wJtt Sriaoj«awt«tlon proff«--1.< to w tiU-iLxtwt. d1d theQirtlclpite l^dlscuisioni^ . 



<Mk1n^ decisions* or carrying out Usks related to the process? 
(CIRa£ 0K£ RESPOftSE OH EACH LIKE) 



UAAHIKG; this scalf 
different fro« rating 



a. Supcrlntendtnt/Asst.* Supt.^ 

b. Other distrtct-level staff 
'c. Mnclpal/Asst- Principal 

d. Teachers 

e. Other school-level suff ^ 



01 


02 


03 


04 


-1 


-2 


-3 


01 


02 


03 


04 


-1 


-2 


-3 


01 


02 ^ 


. 03 


04 


-1 


-2 


--3 


J01 


• 02 ' 


03 


04 


-1 


-2 


-3 
* 


01 


02 


03 


04 
* 


L 


-2 


-J 



9> 



• Throujhout thit lectlon. .ni«r/not ippHctble- If: (1) there 
a pmlcuUr role jnwp u thit »1t<; or (2) It Is too e*rly In the process to 
MSH^r the question. 



ERLC 



'-30 50 



' lOL In yojir^opinloftt how much jnflu^ce did tny pecbtrs of tht llstttf rolt groups htvt over tht 
^ BjijorJfClslOflS In thf tppleacnmton proctsf? Usi thtst 4tf4n1tlons «s guWtllnts for 

Hone or very llttit : K«d Httle or no Input Into decisions, »nd llttll or^ 
^ no Influence. 

Spgve : Hty hivt htd considerable Input Into decisions* but was not e 
strong influence.. ^ 



k orttt deal: Strongly Influenced the decisions; «3y have made the final 
decisions alone. * . * 



(CIRCU 0N£ RESPONSE ON EACH LIKE) ! 
• - ■ 

i 



a. SuDer1ntend?nt/A<st. SuDt. 

b. Other distnci-ievel suff 
c- Prlnclpal/Jt^t. frinclpal 

d. Teachers 

e. .Other school -level staff 





/ 




« 


/ 


01 


02 


03 


' .1 


-2 


.01 


02 


OS- 


. -1 


-2 


01 


vOZ 


OS 


-1 


-2 


01 


0? 


OJ 


-1 


-2 


01 


02 


03 


-1 


-2 



^/ 

-3 
*3 
*3 
-3 



roie grc 
s ^rtdel 



102. In your opinion, Wi*t was the prevaUInq attitude among all cec6ers of the listed role groups 
towards the local project during the 1coienent"atTon process? Use these criteria as jjvndeli/ies 
t for responding* ^ ^ 

Active opposition; Takes steps to underalne or terminate projtct. ^Withholds 
assistance wnen requested, and may even divert project resources to other activities^ 
Prcmtes criticism or opposition to project by others. If attends fieet1ngs» expresses 
strong reservations about project as a whole. 

Passive opposition ; Shows unfavorable or skeptical attitude toward project. Does 
.not protect project from (Arltlcs. Sives asslsunce grudgingly. If attends|^eveet1ngs, 
cjcprcsses Mildly hcgatlve attitude. 

Passive support : Expresses favorable attitude toward projectv but does not take 
steps to assist or coordinate. Hay protect project frora detractors, but does not • 
• go beyond passive dkfense. Promises assistance but rarely or never delivers. If 
attends stings, does not participate In discussion. 

Active suppcrt. Encourages project members tp do a gcgg Job and shows own coocltaent. 
Actively responds to requests for assistance or resouiw.* Defends project before 
critics and helps to coordinate^ with other projects 'or personnel. If attends 



meetings, participates Irv discussion and nay even lead- discussion. 



(CmE ONE RESPOHSE ON EACH UNE) 



a. Supcrlntendent/Asst. Supt.^ 

b. Other district-level suff 

c. Princlpal/Asst. Principal 

d. Teachers 

■ > 

t. Ott)*r school-level staff 



01 

01 

01. 

01 

01 



02 
02 
02 
02 



03 
03 
03 
03 
03 



04* 

04 

Ot 

04 

04 



-1 
-1 
^1 
-1 
-1 



c 

V 

-2 

•Z 
-Z 
-2 



r 



ERIC 

hfiiinniirnrfTiaiiia 



31 



Si 



\ 



CARD 11 
(cont.l 



60-61(62 
63-64. 6& 
66-67,68 



CARD 12 



9-10.11 

12-13.14 

15-16.17 

18-19.2D 

21-22.23 



103 In vo«r ooiwlon. to »AU txttftt las the faculty as h whoU actively involyed in tKT 
tSa^SSfflfirSti^^ to what extent dia the faculty as J^^ole Pirticlpate^in 



^cvsslonsrniking decisions^ or carrying out tesks rttited to the process? (CIRaE 0K£) 

' ^To little or no ejfunt 

To so»e extent - ^ • 
-V* To a j^rtet exteht . . . . .^^ ^ . . . . 

To 4 v«ry.9rtit*^tent - 

-Missing^jdau 

ConflictlHg dau • 

Hot epplicible 



I 



02 
03 
04 
-1 
-2 
•3 



104. It! wur opinion, hw wch Infloeflce did tht ftcuUv *s « whole have over the eajor decisions 
in tKe iMPleatntitlon process? (CIRaE W&T , - - 



IJc«e 0*" v*ry,,l Ittlt 

^ '. : 

^Missing (UU . . ^ 
Conflicting d«ta . 
• Hot ipplleibl*-*- . 



"Hi 



01 
02 
03 
-1 
-2 



105. During the l»olefflenmion suge. was thert • foraally constltute^faroH^-other than the 
faculty as a t<tio1e--specfflca11y t»powere<J to wke decisions or carry out tasks rtlated to 
InpImnUtlon? (CIRCLE 0K£) 

IWOPLlfjffXz The ^rogp should ceet the following rfiterle: 

• It Bust have a label (although this wy be infortal). ' . ^ - 
' . It Kist include, at least twj^UtPict or schpol stiff. 

• It B^st ipcliide at least one 'potential inpleroentor*' , 



yet . . . . - 

no \ i 

Kissing 6$U . . 
Conflicting xiau 
Hot applicable . 



01^ 

00 

.1 

-2 
*3 



SKIP TO QUESTION lU 



106.. Ho« »any wmttffo^ the group you described in Section IX were also wscbers of this group? 



(CIROE OHE) ^ 

Kof>e 

Few (less than iOS) . . . . 

Sc»t (2(Mn). i 

A large pr«Jportiop (50-791). 
All or Most (over '80X1 * - . 
Missing dau . . . . ^. . . . 
Confl feting data . * .-.^ • 
^t applicable 



- 01 
.c02 
. 03 
^ 04 
. OS 
. -1 
. -2 



v 



82 



32 



1 2 



1 2 



dfta 12 
(cwt,) 



24:25,26 



27-28,29." 



1 I 



1 2 



30-31.32 



33-34,35 



A wCTg^dJclsloniV^Cirryirig out tasks rfltted to u^e processr (CipcUteC) 

/ To flttlt or no cxttnt . » \ • 

' • To'spc».jixUrtt 

, To « great txtit^t . . ^ J • • • ;^ 
To 4 vtry gre/t*txtcnt . ^ - - *. 



/ J ' > .... 02 s 

,03 <^ 

\ * -Oil. 

ConfKctlrtg data 



, . /• * • »' -2 



Kot applicable . -i^ • • ' ^ : • • 



108. In your opinlofu W «ucb influence did this group have over the oaior decisions in the 

toleffientatlon process?.- (CIRCU CHE) 

' ^ IKPORTW: Us^ the sane guidelines. as Ar Question 101. - ^ •> ' 
None or very little . . . 



* * ' . \ til 

A great deal . . . . w . . . . 



> Missing dau ; . 

^ Conflicj^ing data 
.Hot applicable 



V 109. On what level was this gtoup organized 

(ci«i£ csrr ; * 



and focus sed <kiMng t^e iteoleneftUtion stag^^^ 



« . . 01 



Thts school alone .^^ 7 . • • . ^ . . 

k Several Kho^fs . .V ^ 02 " - 4 

The district as a 03 

, Another level . . .'. ^ >>• • ' ' • 

Mining d*u ^ ' }.....--» . 

Hot jppiiMWe \ . ./ . -3 

^ • • >- 

110 was tiie prioctwl or other scW a^ainl^trrftor a «>csfsbcr"of this group during the 
!SlSn?iSlsiug^^ (NOTE. Msv^ V^f^^ 
^'if he/she %^s rK>t very acti^^*) (CIRCLE 0K£) . ' n ' 

>^ ^' ' ^ ' or" ' 

Yes ...... ' • • * 

* ^ * .00 



Hissfng data . . ^ \ ' * ' \' ' ' ' \' \ 

C<»ifl«t1ng data^ . . .-r . ^ *• 

Not applicable . \ . . • ^ • • ' ' • • • ^ • • ' ^ • 



-1 

2 
3 



i 



4 \ *^ . 



. ♦ 



ERIC , ^ . . ' ■ ; 33 "6^3 





ni In voir opinion^ to irfut extwt .wtrt the ichotfV i iMlwtntit oj »ctlv<t<es congruent with 
I iSJr ?rSl^ol*lr«} prictlce*? Use the critlri* Hste^ In hk 1 of the «««r*n<lui on « 
' ,$-sfcKT=?5oT?Tn9 »del. (circle; ONE) J , 

' . 01 

-,• 02 

. / ,* 03 

M 

. . .1 



. To'tHQ^f^ nttnt ^ 

To $OBt',fxUnt . * > • * • 

To a grt«t txttnt ; 

To a very srtAt txtcnt * - - ^ ■ 

Missing d4U ♦ ^, - , / - V - - - - 

. Conflicting daU ' / 

Hot vP^icibU ; • • , I - - 

Plctse write the Utter (froo the Beasrinduffl oft in "ideal" probleo-solving oodclf corre- 
sp^inrio etch crlTeriin you fee] ^s not adequately ^et by the schools iaple«nUtion 
activities. 



-2 

^3 



112. K 



n yojr opinion. Jto what •-.t^,, ^rc the ».^wT; f.^1e^ntg-sr ^ctivK^cs ccngnjent witft 
SuiKrcup decis1on,«^ practices? Us> the criteria listed in Part 2 of -Ue ««r»hd« 
Tmng aodel- (CITICIE Cf(E) 



sound crcup g- 
OA an "Ideal" prooitsns 



01. 
'02 

03. 
04 
*1 
-2 , 



-3 



113. 



' To little or no extent' ■ 

To sc«e extent 

' .To, a 9reat extent - 

To a very great extent -^p - p 

' Missing daU p - p' 

'Con<littin9 daU - - 

^ Hot applicable'- t ; ' " 

Please write the letUr (froo the woorand^n on an -ideal" probleca-solving eodel) ccrre- 
spSdinHo each criterion you feel «s not adequauly «t by the school's icpleoentation 
activities- • . ^ 

- — 5 

Wufli mr tssessscflt ftf the levtl of effort devoted^o the school's Hyleatntitlon 
Sivitlefry iKjlschoSl or d istrict personne l? Use these crlterii ts guidelines for 
responding, but aak* * rough estlwte If ftee«ss»ry. ^ 

low; less th»n 10 person-<J*ys 
A' ^^IS} "10 ^ 30 person-dJ^s . . • 
. High: over 30 pe«cm-d*ys. 

(ClftCU CHE) 



^ - - 



Low p - * - 

HedilA 



Mis^sin^ diu p 
Confjicting^dau 
Hot applicable . . 



01 

02 

03' 

-1 

-2 



I 



• 4 



ERIC , 
I 



,•34 



'^4 ■ 



1 2 



1 .2 



CARD 12 
(cent.) 



48-49,50 



51-52,53 



54-55,56 



Ban 



A 



'■ ■ 

lU^ «tr« any scbopi stiff provicJeil ic*ln1n9 In group jJfocejj, proble>:$ol»^*ng, or dectslon-wklng 
" ^skllU ttchnlQueS? (ClltCU ONE) 



*Coftf1 feting datj . 



01. 
00 

-1 



tl5. Ifl yoor opinion, wii there it leist one iftdlvldwl. at the schoolV district level, who %rts 
a str5n« irxj fffKtlvfe " InWmal ch<nqe iggnt' for this school--1.e. . w4$ there inyone who 
sort 6f took charge, kept things ocving, resolved »1f*or problems, and w4$ ible^to whip up 



wtltatloft ajcung^thc.suff? (yRCLE^OtE) 



tes 

NO .\ 

Missing data . . 
Conflicting dau 



r 



01 
00 

-1 

-2 



SKIP TO QUESTION 117 



116, What type of individual served as the 'Internal -change agent' for this school? (NOTE. There 
' «ay haye been tore than one, i>ot probably no Pore than three.) 

(EXTER A T IF W IKOlVItXWL TOH TME CATEGpRY SERVED AS A« IHTJRKAL CHANGE- AGEMT" AND A 
^0^ IF NOtI EHTER -^r WU HMTHERE is HO IHFOWATIOM RELEVANT TO TMIS QOESTIO«. IH THAT 
CASE, aiTER '-I" Off AIL UKES a-f.) 



a. Superintendent/ Asst. Supt. 
to.. Other district-level suf f 
z. principal /Asst. Principal 

tJ. Teacher .1 - 

e. -Otherichool -level suff . 
r. Other (please specify): 



1 2 



1 2 



CARD 12 
(cont.) 



57-S6,59 



60-61.62 




U vour opinion, was thcr* any group O^lch served as a strong and effective Internal change 
aoenT^a*' for this school— I.e. » was there any group which, as a unH* sort oTtook charge, 
kilpt things fovlng. resolved «^nor proUew, and wii able tp^whlp "P. ««t1vat1on a,*oung the 
staff 7 (XOTE. Thl^ group may have existed in addition to or Instead of Indjvlduil Internal 
<h*n9e agents.-) (CIRCLE OKEL ' / ' • 



\ 



Tes 

• No '. . 

MlUing data . . - 
Confllctlijg d«u 



....... 01 

. . /.oo 

:i -1 

....... -2j 

' SKIP TO QOESTION 119 



18, Wai this ofocp foTpally esubllshed or f»powered 16 eake decisions 
to the ROD project? (CIRCLE OKE) , ' . * 



.tts . 



"loifs of carry out tisks related 



Ho 

i^^ssWdau . • 
Conflicting daU 



• • * • • 



01 
00 

•-1 

-2 



V. 



\ 



ERIC ^^^jj 



\ 

:35. ; ^ \ 



1 2 

1 .2 

1 2 

1 2 

1 2 

1 2 



1 



t 2 



63-64.6S 

66-67, $8 

69-70,71. 

72-73,74 

75-76,77 

7B.79,80 

• J 



CMD 13 



5-10.11 



1 ' 
12-13,14 



J 



r 



IIU immi SmTtGIES AND TACTICS 



• DiPOftTAMT; If th«rt h«s been tny turnover in linking igents, «n$^r these questions 

• 1$ If they >firt the sm individutl. However^ if the 'linking agents behaved very 
: differently on a particular ita*. answer it only for the linker Mhost Unure over- 
j lapped with the jchoqrs participation the longest. 




IMPORTAWT! Each and every sitiT in the/WO pnwraa had a linker assigned to it. Just 
: because a linker had no cootatt site (this happens in a few cases) is no ^ 

* reason to ur> these questions "not applicable.* 



119* In 
fu 

(CIRCU OKE RESPCriSi OK EACH LIKE) 



In JSSL opinion, to »<hat exUnt has. the linkiiig agent perfonned the following services or 
fimcHMa for this school? 



W^SVj. Thit sctle is 
41ffertnt /roa ritlng fona. 



«■ et 



a. Observing/docuMnting activities 

b. -Orienting school suff to the 
ftOU project 



c. Providing ( not arranging for) ' 
training In problem solving or 
group process ^ 

d. Providing (not arranging for) * 
training Irt a currlcular area 

e. Facll luting the group process— 
e.g.. by resolving conflicts, 
guldlnig discussions » helping to 
set goals 

f. Coordinating/lining up resources 
(hwan or material) 

g. Provldlfvg expert counsel/technical 
assistance related to: ^> 



01 
01" 

01 
01 

01 
01 



02 
OZ 

OZ 
02 

02 
02 



03 
03 

03 
03 

03 
03 



04 
04 

04 
04 

04 
04 



•1 

-1 
-1 

-1 
-1 



-2 
-2 

-2 



\ 


- Olagnosing the problca 


01 


02 


03 


04 


-1 


-2 




- Assessing the match between 
innovations and probleas 


01 


02 


03 


: 04 

*^04 


-1 


•2 




Iflp^mntlng irt Innovatlofi 


01 


02 


03 


^ " .1 


-2 




Evaluating solution Ivble^ 
fientatlon or effectiveness 


ai 


02 


03 


04 




*2 




h. ' Providing asslsunce such as 
l^lervlwring, .helpM *rith , 
proposals, etCi 


01 * 




03' 


04 








1» Serving ai a coiBunlcatlons link/* 
lialsoA bet^en. school and project 


01*^ 


02 


« 

03 


04 


-1 


-2 



; WPORTAfd: For QuHtlons 120-122. answar "not applicable" If the particular 
• suge had not been reached. Al^ answer *not appllc^ible" for (^estlon 121, If 
S theVe wer^ no meetings. 




3S 



86 



1 2 

1 i 

1 2 
1 2 

1 2 

1 '2 



) 



1 ^ 

1 2 
1 '2 

1 2 
1 2 



CARD 13 
(coot*) 



1 5-1 6 .1?- 



18-19,20 



21-22,25 \ 
24-25.26 ) 



27-28.29 
30r31.32 



33-34.35 

36-37.38 
39-«),« ' 

«-43,4 

45-46,47 
48-49,S0 



' . 9 



120. \^ frtovmc nvrt^tM ItpUrtlittd fice*to*facc conUcU bttmn tht linking igtnt ind tht 
tchool oyrlftg tich ftUgt of tM ^oblc»*solvTng prociSsT > 



(CIROE OKC KESPCtCSC CM EACH LIKE] 



t. 


Protiltii 1dtnt1i;ic«t1on 


01 


\ 02 


03 


04 


05 


-1. 


•2 


-3 


b. 


Solution tilKtlon 


01 


02 


03 ■ 


04-^ 


05 


-1 


-2 


•3 


c. 


Pliming for InplewnUtlon 


01 


02 


03 * 


04 


05 




-2 


-3 


d. 


EaplMlflUtlon 


01 


02 


03. 


04 


05 


-1 


-2 


-3 



121. thit proportion of the westings of the declslon-MkIng group were attended by the linking 
«9ent during e«ch sugeT 



J22". 



ERIC 



(CIROl OKC KESPONSE ON £ACH LIN£) 



Prct>1cs ItftfitifluClon 01 % 02 03 04 05 -1 ^ -3 

-b.. Solution selKtloo nOI ' 02 03 ' 04 05 *1 *2 -3^ 

c. PUftnIng for InplcffenUtlon 01 02 03 04 05 ' -1 -2 -3 

d. N)l0ieflUt1on 01 02 03 04 05 «1 • -2 *3 

In gtncral. hem such Influence do you fetl the linking tgent hoover dKlslons nadc by the 
school during etch sUgt? us« these definitions as guidelines f&^^r^poodlng, ^ 

Kont or very little : K4d little or no Inpgt Into decisions, tnd little or < 
no Influence. * • * 

Sotf>e: Hay hive had considerable Input Into decisions, but vas npt a 
strong Influence. 

A qrtit dtil; Strongly Influenced the decisions; uy have nade the finely 

visions alone* ^ / . ' ' , 



(ClftOE ONE KCSPCNSC 01 EAQf LIKE) 



5?» 



a. 


Probldr Identification 


01 


02 ■ 




-1 


-2 -3 




b* 


Solution selKt1oc#^ 




02 ■ 


03 


-1 


-2 ^ -3 






Flaming for lapliisentatlon / 


01 


02 


03 


-1 


.2 ' -3 




d. 


lAplcaentatlon 


01 J 


r 02- 


03 


■ -1 


-2 -3 





123. In yotlr op1nl6n. i^hlch of the folloifli^ responses best describes the roTe the linker 
assSt? In hts/her deAlngs ultK thls^^chool? (ClftOX OKE] 

4 Hondfrtctlve rtf ponder r The linker reacted to the Initiative of 

the (ite. letting the systca draw upon his/her at Its own speed. 

Indirect strvcturtf: The linker was Ktlve behind the sctnts* 
% structuring the situation to Increise the likelihood of succesit 
but gettlno the school gv^uo'to assuee rtsponslblljity for the 
^jKt. In pu6l1c. the linden ms usually a^nonpartlclpant ^ 
oblerver or passive partl^pant. ^ • . 

Mr^t Int^enor : ^The linker MS heavdT^volved 1n-the local 
efforts and assuitd direct leadership of the process. He/she . 
usMTly inltfated actljvltles. chalrtd'metflMi. and followed up' 
M^utls* uhlle the tlt^ responded in a 9i6re passive My* 

. '-mttfnjdata 

Confltctlnf data • • • t ^ 



01 



02 



03 
*2 



i 



zoo 13 
(cont.) 



51-52.53 
S4-55.56 
57*58.59 
60*61 .62' 



63-64.65 
66-67.68 
69-70.71 
7?.73.74 



CAftO 14 



, 9*10.11 
12*13.14' 
15-16.1> 
18*T9.20 



21*22.23 



!ii your ooiniort. which of tht following rtsponses b«t describes tht linker's rtUtloMhlp 
idtj^TSt^ndlSld^ ty* rolt of •Inttmil chtoge tgwt- for this school? (Set 

QtiesjtloA 116 ibovt.) (CIROE ORE) 



The linker *M tht InttfT^l chtngi »gent hid little conuct 
with Oftt Mother . . . * . • • . 



01 
02 



1 Z 



Tht tinker ind tht inttml chtngt egent htd i cpnHlctlng* 
'or coE^tltlvt rtlitl^onshlp.; thetr roles were oo^ co*9l«s«fcUry. • . 

The linker supported the -work of .the Interntl chtnge agent; the ^ j 
Internal change agent took a no . rt active coordinating role than 

tht linker ' 

The In^mal change agent suppoKfe the work of the linker; 
the Internal change agent took * lesi active coonjlnatlng role 

than tht linker ^ • 

' Tht linker tnd tht IntemaVchtnge agent worked tfosely as a teao;' 
they wert equally active In f^rdlnitfng the project In this school, 

Hissing dau * 

Confiictitig wat« , ■ • ■ - 

Kot applicable* thert wa^ no ffcwho played the role of * 
•Inttmal chan^ agm* for this school 



03 

04 

0^ 
-1 
-2 



xm. PftOCESS OUTCCK£S 



1** 



According to school personnel* how Ifiocrunt w^^^^ 
acccopllsh Its proble»-$olvlng tctlvHIei? (CIRCLI OHE) 



nt was the linking agent In helping th 



lool to 



UAMING: This scalt Is . 
different froa rating forw. 



Kot at all or not vtry 
S<»e^t lBportan(\* 
lAportint . « - 
' Ytry If^runt . - 
MUvtn'g dati 
Conflict 



rtant 




01 

I 

03 
04 
-1 
-2 



1 2 



126 OyeralU how satisfied vert feabers of the listec role groups w*th the assUUnce. Services, 
or support 'provided by the linking agent? 



(ClftaE CUE RESPONSE ON EACH LIKE) 



t, Superlntendent/Asst. Supt. 
b. Other dlstrlct-levtl stiff 
Princlpil/Asst. Prlnclpii 



Ttachtf* involved In R£W 
Unidentified^ ' 



m' 

01 
01 
'01 
01 



m 
oz 
pz 

02 
02 



.{ 



V 

^ 03 
03^ 
03 , 
03 



04 

04 
04 
0* 



*1 
-1 
^1 
.1 
-1 



-2 
-2 
^2 
-2 
-2 



-3 

-3 
/ *3 



•For OtfMtlow 1Z6.128. *M^r W ipp11«b1e- 1/ the Infl'l'^wV*) J*^ » 
lLft(<l»<He of tA linker, knwledgi b*«. orprocesj thit eplMon 
mijer 'not •ppllcaWe* Jf there »»ei* •« ■wberJ of tht role group « thlt slu. 



ERIC 
I 



33 S8 



CMO 14 
(cont.) 



Z4-Z5.Z6 



Z7.Z8.Z9 



30-31 .32 
33-34 ;3& 
36-37.38 
39-40,41 
4Z-43.« 
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OvtrilU bow >tthf1ed Mtrt »eab«rt df tht fisud rolt groo^ with tht ASSUUnct* strvlces. 

or sufipafl.prcvJdeci b/ the 1uwwle<iqe btit? ^ ^ ^ \ ^ 

fciRCLE we mi^i on each 



4* 



5?* 



t. 



^perlAUr>der(t/Asst« Supt* 
Other dhtrjjct-level suff 
PrlnclpAl/Asst. Principal 
Teichers Involved In RDU 
lM< dent i tied 



01 ' 


02 


03 


. 04 


-1 


>2 
.2» 


•3 


1 


2 


01 


02 


03 


04 


-1 


•3 


1 


2 


01 


02 


03 


^04 


-1 


•2 


•3 


1 


z 


01 


02 


03 


04 


-1 


•2 


-3 . 


1 


i 


01 


02 


03 

• \ 


04 


•1 


J 


-3 


1 


2 
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Overill^ how satisfied ire resEt>ers of the listed role groups with the p rocess they went 
thro^f*-'1,c»» v\t sf^'^s t^^t werr v^xa^ •'^d ho* ofs^sions were wee.'* 



(CIRCLE ONE ftESPOHSE ON EACH UK) 



d. 
■e. 



Superintendent/Asst. Supt* 
Other dKtrIc thieve I %uff 
Pnnci pal/As St, Principal 
Teachers Involved io^ktXk 
•Unldentlfl^ 



01 
01- 
01 
* 01 
01 



02 
02 
02 
•02 
02 



03 
03 
03 
03 
03 



04 
04 
04 
04 
04 



•I 
-1 
•1 
•1 
-1 



>2 
•2 

'-2 
-2 



-3 
-3 

• 

-3 
-3 
-3 
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In ;c2!i£ opinion, how differwt i#is this process fro* the school's previous attfffpts to solve 
pi^obT^ or to adopt flew^progrtfs or Mterlals? (CIRCLE OKE) 



•To llttlji or no extent . 
To scoe extent • • « • * 
To i great extent • • • 

, To i Very 9Wi extent • 
Missing dau 

^Conflicting dtu • • • . 



3 



01 

«. 

03 
04 

r 

-1 

-2 
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looking it the five sUtesiefltt below, choose the W sutewt that best describes the extent 
to which this school .has subse^iitntly used the sw process to deal with other school prob- 



(CIRCU OKE) 

They irt\pe«ting (or h#ve 'repeated) this pnxess to solve «t least 
one other problen in the school ^ 



01 



They irt adopting (or have adopted) sc«e pirts of the process to ^ 

solve another problen 1e the school 02 

They have not used the process to solve anbther problem, bat* they ' 
art planning definitely to use It In the future • • ' 03 

They have not wsed the process^ solve another problea* but tftey J 
probably will In the future . . . 04 

It Is unclear Oiether they have u%H the process again or i^ther 

there are plans tp use it in tht future 05 

, . ^ , : ; 

. \ , .,-2 



Missing dau . . 
Conflicting dau 



ERLC 



39 



S9 



1. 2 
1 2 
1 2 



1 2 



1 2 



CAKO 14 
(cont.) 



45-46^47 
48-49 tSO 
51-52.53" 
54-5J.56 
57-58:59 



60*61 «62 
63-64,65 
66-67,68 
69-70.7J 
72-73.74 



7S-76.77 



78-79^ 



hi. 



0»er«ll. »*«t *r« tht curwt ittltudti of the Usttd roU groups to»rtrd the schooTj 
p«n^lC1p«tlOft In the ROU pcojKtT *. 

(CIRCLE ONE KSPOSE ON EACH Lllff) 

Ok 




v^y* 



b. 

c. 

t. 



Other <Ji$irici-lml %uU 
Princip4l(A$$t- Principal 
Ttichers irmjlved in TOU 
Ttichtrs In gcfitrti 
Unidentified 



01 


oz 


03 


04 


05 


. -1 


-2 


-3 


01 


02 


03, 


04 


05 


-1 


-2 


-3 


01 


02 


03 


04 


05 




-2 


-3 


01 


02 


b3 


04 


05 




-2 


-3 


01 ' 


02 


-03* 


04 


05 


-1 


-2 


-3 


01 


0?. 


03 




05 


' -1 


-2 


■ -3 



in your oP'nIw.. to -h*t t.U.i Old the t«cnerj wr.o were mvclvM in .t the school 
nt^i^thls effirt *s « ipecUl -projecf-l.e... southing out of the ord1n.ry? (CIRCLE wtj 

— TftiiitJiLfir.oo extcfVU* --i-:*-. vjl ■ :.JL -.JU^W. 

To s« ex^i ■ ^ 

To t greil extent * ■ ^ . - * - 

To 1 very greit exUnt 

Misting ditj . ' ' 

Conflicting <utj i . . . . 



01 

02 — 
'03 
04"^ 
-1 
-2' 
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n vwr opinion. tc^U extent did ttic Uichers »rfto were !" ^ ^^SSi^^J^l? 

ndirtlind thjt this effort pirt of * Ijrger progrw stJtc or nitlontl level? 



understand thjt 
(CIRCU OKI) 

To little or no extent - 
To saoe extent J . . . . 
To t great extent . . . 
To « very greit extent* . 

Hissing ditJ 

Conflicting €ku ^ . . . 



01 
02. 
03^ 
04* 



!n opinion, to wtuJexUnt did the U|^rs W.o «tre ihvg^^ ^n m tfthe school 
gi>dtrstind wfiit'thi^ *-tre expected to do ind ^ (CIRaE ONE) ^ 



To little or ft& extent 
To extent .... 
To » great extent . - 
To k >very greit extent 

Hissing*dtt4 

Cooflicting'ditJ / . . 



01 
02 
03 
04 
•1 
-2 



jcARD 15 



2 
2 
2 
2 
2 

1 ' 2 



1 

■ 

1 
1 
1 



9-10.11 

iz-n.u 

1 15-16.17 

liB-ig'izo, 

I 21-22 .23 
24-25.26 



1 2 m-JiB.29 



1 2 30-31.32 



]. 2 ■33-34.1S' 



teu«r 'not twUcible" If .the ln<JWldu*l(j) h*d to little krowleds^of the P«>j«t 
S^i, SJhlS «s po«lble. AUo ,nsi«r ."not eppllcible- If ther?-re « ««bers 
of the role group *t this site. » i_ , ^ 



0 



«• .90 



IKS: 



RIC 



OftGAXlZATKyul OUTC(KS-AM) OJTCqtfS FQft PAftTICIPATIHG, STAFF 

Mh*t 1$ youf issessficnt of the w*y5 in which tht following chiricteristics iSf the school have 
chiftgf* «rr rtsuU of tht school's involvc^aent ia the MW projt|P 

(CWat OHC «SWKS£ ON EACH LIHE) / - 

















• 




• 


^/ 


// 




J*! 


/^^ 


*/ 


if 




pro&len*solvin9 prictices 


01 


oz 


03 


04 


OS 


•1 




2 


b. Stiff Mrcness iftd acceptance 






03 . 


04 


05 . 






1 2 


of nCD products 


01 


02 






c. Pupil perfortuncc Mni behivior 


01 


02 


03 


04 






•2 


1 2 




A * 
ii 






0^ 






-2 


1 z' 


t. Frequency of interstaff * 


01 


02 


03 


04 


05 






1 2 


comrnicition 


-1 


X C«rricul»* ind/or'natferiils 


01 


02 


03 


04 


05 




-2 


1 Z 


9/* Jeiching n«thcdolo9ie$ 


01 


02 


03 


04 


05 




, -2 


1 z 


h. OrgaMzitionil structure 


01 


02 


03. 


04 


05 


^1 


- -2 
* 


1 2, 




* 

01 


»02 


' 03^ 


04 


05 






1 2 


in decision-f:4kin9 






-2 


J, School's ittA9e in the 'district 


01 


02 




04 


05 






1 2 


fc. Severity or scope of the pfoble« 


or 


02 


03 


04 


05 




-7 


1 2 


1, ^se of specialists 


01 


02 


03 


04 


05 




-2 


1 2 


a. Cocmnity or pireftt injiplycffltnt - 


01 


.02 


03 


04 


05 




-2^ 




Cllfsroon orginizttioc 
or nanigeeeflt 


01 




03 


04 


05 




-2 


1^ 2 


0. Other (specify): ; 

* 


















01 


'02 


03 


-04 


05 




-2 


" 1 2 
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CARO IS 
(cant.) 



36-37 ,3d 

39-40,41 
42-43 .a 
45-46.4? 

.48-4? .50 
51-52,53 
54-55.56 
57-^,59 

GO-61 .62 
63-64,65 
66-67,68 
69-70,71 
72-73,74 

75-76,77 
78-79,80 



"LINKING R&b Wrm SCHOOLS 



A Study of the R&D Utilization Prpgram 
Teacher Questionnaire 

Fain 979. 



Dear Educator: 

Your school has recently Been part of a nation-wide pVogram sponsored by National 
Insiauic of Education. The pros'^m calieo t..e Res^arcn and Development Ut-y^^.o,. 
Xu) program, although you may knfw it as the Florid* Linkage System (FLS^ A" 
mporiint part of this ptosrzm was to h^p teachers and administrators clarify and so ve 
1^? problems more ^cctivety. A m/ijorlfeature of the program ,n most schools ^^s th| 
involvement of a local planning team or steering commi ttee CQpPo y^Q\ ^ •? 
administrators. This team frequently worked with an 

particular problem in basic skills and then to select and implement one or mWte«esMrch 
based programs or materials** to solve it. ^ 

One goal of the National Institute of Educatipn.inrsupporting the program was to learn 
more about the local school improve-Dent pr^e^ «nd the role that externa ly deveioped 
materials can play in making it more effcctivl To this end, Abt ^^•«« '"S* 
social research firm, was awardeda Contract to conduct a study of the RD^ pi^gram 

A majot source of information for our s^dy is,a survey of principals and > 
uachU at each school which has participated in the program We are "^^'^g y°";°/°^. ^ 
^te a questionnaire this one time, providing information which 
Enderstandirig of the oeedS and successes of schools as they attempt to solve ia«lly dc 
fined problems. It will take approximately 30. minutes to complete this questionnaire, 
■ which you may then returj, directly td .us in the enclosed postage P>'d wjvclopc. The in- 
• formation on the inside cover of the questionnaire provides .further details on the pro- 
cedures we use to protect the confidentiality of all dau we collet. 

We would like to thank you in advance for yourcdoperation in helping u> to learn aboyt 
the' RDU program in your school. - ' * 



' Karen Seashore Louts, Ph.D. . 
Project Director • 



* •According ta'ouf records, the iinklnj ajent who worked with your school was 

• . ' \ V . 

* •Our reco?ai Indicate that your school adopted the following rtieifCh -based program or materials 




■ ■ l • — f — • 1 

I Abt Associates Inc., an applftd social research firm, has ^atmploycd I 
p Ij ^ Kitlsr^' :r./.;:utc cf Cdur i::n to cop.i'jct a Study of the R&D • 
Uunzauon Pro^fam, The information that you provide will contribute • 
to a better understand tn£ of how the problem solving process works in 
schools and the role that exumally developed programs and nuteriaJs 
can'play. 

Pleue be assured that your participation in this study is entirely volun- 
• tary. Althouj^ wc urjc you to complete the questionnaire in the inters 
ests-of the study, your participation or non-participation will in no way 
affect your standirfg or your employment in tJje school. No mcmtltr.of 
the school disuiaVl) have access to your responses at any time. To 
protect your anonymity your name does not appear *on the question- 
naire. The number on the lower rigtit^and corner of the cover Is used 
to record the receipt of your questionnaire. No information about any 
Individual res(A>ndent will be identifled^y her/his name or be identifi- 
able in any reports published by Abt Associates. ^ 

All reports wc compile will combine your answers with those of other 
professional personnel so as to/cspect your prWacy and the confidenti- 
ality of the daa you have given us. You may, of course, omit any 
questions which you consider to be objectionable. Your answ^s to all 
questions will be placed on a computjet Upe without your name, along 
with ansvms of other retpondents, 

Dau being collected under authority of Section 405(b) (2) Of the Gen- 
eral Education Provisions Act, as amended, 20 USC 1221c(b) (2), 



<1 
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School Setting 

1. Ptcajc irxllcatc the type of school In which yotr arc employed (Mease check one.) 



PrifT>ary/elemenury school , 

' Middle school 

junior high school 

Senior hi|^ school 

If some other kind of school, please describe 
rtot employed in 'a school - ■ 

* 2 What 5s your position? (Please check one.) 



t ■ 



Qassroom Teacher 

School administrator . ' 

School level Jpeciatist (Please describe ) JL- 



Other (Please describe ) T — ■ ■ ■ : 

/ 

3 Jf you are a classroom teacher, what trades are you teachint this year? (Circle all the grades you currently 
teich.) . ^ 
PK K 1 2 3 4 5 6 7 8 9 I'o 11 12 



R&D Based MaterialsLor Programs 

4. H« your idiool of dimict.$dected an R&D based propam of materiali as a result of pirtkipatjoo in the 
FlofidaLinkaje System (FL5)? (Please cheek ofK.) ' \ ' 



Yei. 

No, *e are still in the process of identifying the problem ■ 

No, we have identified the problem but have not yet finished searching for the 

best solution r. ... ■ ■ v ' 

No, we have.searched foTa solution but the programs or inaiertjis we have lo«ked at 
don't seem to meet our needs --^ ■ • • 



Don't know 



If No or Don't 
Know, skip to 

Q. le 



5. DkJ you personally parttorpate in the decision to adopt the R&D based propam or maWals your schools - , j 



using? (Please check one.) 



Yes 

No 



d / 

ERIC - , ' .\ ' 



6. Thinkini back to the form or content of the R&D ba^ program or "^fj^^^^^ iSfJiSS^r^ 
modJ^cations required to use the pror^m and materials in yowr schooP (For example, were different 
malerUls or approa^hei substituted or added?) (Circle one on the scale below.) 



NOT AT ALL 



TO A 
LITTLE EXTENT 



TO SOME 
EXTENT 



TO A GREAT 
^TENT 



TO A Very 

GREAT EXTENT 



DONT KNOW/ 
CANT RECALL 



If NOt AT ALL OR DON'T KNOW/CANT RECALL, SKIJ> TO aS 



7. To what extent did the following groups or individuils participate in decisions concerning modifications of ^ 
R4D based -program Of materials in your jchoot? (Circle one on each line.) ' ^ 




a. You, yourself ♦ 

b. Other teachers 
Q L The principal 

d. A school or disin'ct specialist 

L The deveIoper{s) of the RAD based 
programs or maunals that your 
school adopted ' 

f! The hnking agent • ' 

Other individuals associated with FL5 

4 

h. Other experts from outiide your 
disutct 



NOT AT 
ALL 



0 
0 
0 
0 

0 
0 

.0' 



TO A 

LITTLE TO SOME 
EXTENT EXTENT 



* TO A OONTjr 

TO A VERY KNOW/ 

GREAT GREAT ' CAN'T 

EXTENT ' EXTENT RECALL 



1. 

1 



2 
2 
2 
2 

2 
2 
2 



3 
3 

3 
*3 

3 
J 
.3 



4 

4- 

4 

4 

.4 
4 



& 



Do you ptnonoiiy u'je any of the selected R&D based programs ^r materials? (Cheqk one response^) 

No, I have never used it and do not expec^tolise it in the future 

No, but I have used it in the*pist . . . ^ . - . . - - - - ^ - ^ - - • - 

No, but I will use It in^^d^uture » ... r - — * 

. ■ 4.- 




Ycs \ 

(Please name the program(s) you are using}- 



ERiO 



ff tES fnt*it»m¥w« thf fo*,lowift9qu«noni If Viiytuw mott th*nx)n# pfoyam ^ 
or t«t Of miStrktli- intMf iht ont you uw trtt moti ^ 
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A.lfY)s, approximately what month and yeir did too rintUpn w uufjh^jnff^ 

' ' Month ' • : : • 

8, If YES. with approximately what pirctnt of .your studenu do ^ou the progam or matenals? j 

-^Ih 

. • • ■ . ; - - 

aeck here if not aj»pHcable because the projrtni 1$ not u«d ^ 

directly with students » LJ ^ , » 

^ 1 
C // YES, on tht average, how tt^%(lays per week do you use the program or-materials? 

»\ ' .Days' — • 

, , ' Check hers :f not"5^p!icable because program is not uscd oh 
' . areg.,!^^.../... ; LJ 

' 0. If YES on the days when yoo use the program or rnaierials, approximately Jiow rnany mtiutes per day 
do you use it? (Please respond in minutes.) ' . ^ . ' 

Minutes — ^ — J * ^ '< 



Do you plan to continue using the selected R&D based program or mitcrials thi future? (Check one.) 

• • • 

Yes, with Jittle or no modification . % - . . v ' - 

Yes, but >Mth some modiTicatJons ..... ^ • ; • >• 

• Ye*, but with major mixJifications ^. . : . ■ 

No; I will not use It beyond this year* ' 

htetapptoWe. the programmer fVterialsOT designed to be used only.^^ — ^ , ^ 



10. Pl«a$9|iveusy<wro^/fl/ononthefotlo'wingchara<ie^irtkaofth^ . " 

^circling the most appropriate re«>on«- (Circle one on each line.) . ^ 

• ^ " ' . ■ ' ... to A ' OONT 

TO A vCRY not . „KNOW/ 

To what extent do the fdectcd #>v ^ ' ^ . ' T 

projram or nuteriaU . • . ^ • ^ 

V S^mdirccUy relevant to the ^ 
mojt prcssinj problem or y 

^ ^ need In your school? * 0^ ^ 

. b..Mcctandedinyour 
, . classroom? \ ' ' 

c Provide adequate guidance , ; 
/6r implcmenuilon?- ' 0 ' 

% ' d. Provide kJcas and 

not lust Ideas you.alrieady v 
knew oV were using? '* Q 











s 

J 




1 


2 


.3 


4 






1 




3 






* 


















3 


4 


■ N/A 


• ? 








f ■ 
















1 ' 


< 

2 


3 




N/A * 





TO A " OONT 

. TO A TO A VERY NOT KNOW/ 

NOT AT LITTLE TO SOME GREAT GREAT >CfPLrC- CANT 

ALL EXTENT ' EXTENT EXTENT EXTENT ABLE RECALL 



« t, Require subsUn'tUl change 
from^^r pfcvious 

Require chmge in the 
way your classroom is 

orpnized or managed? 0^ 
• « 
Require substantial addh 
Uoful record Iceeping on 
your part? ^ 0 

To what extent 

^^^Has^ it been difHcult to . ^ 
irr^Ienxnt this program 
or materials? 0 

u Has imptementatjon of « 
the program or materials, 
helpisd solve the most 
pressing problem I'n your 
school? 0 

Was it necessary to use - 

materials from scvwal 

R&D basfcd programsJn 

order to nmt your 

need or solve your 

problem? ^ v ^ 

Was It necessary to develop 
t ' additional materiaJs locally 
In order to 'meet your 
.need or solve your 
problem? • - 0 

I. Has pupil achieveri^ent \ 
^ improved as a result of > 
tfie of the program ^ 
_,br nuterials? ^ 0 

m. Have pupil attitudes or 
behavior Improved as at 
« , result of the use of thfs 

' program or materials? 0« 



. * 



'3 



3 - 



4 



( 4 



N/A 



N/A 



N/A 



n7a 



N/A 



4 



N/A 



N/A 



N/A 



N/A 



? 
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^ 11. About ho^ many hours of uainmx sessions (kctures, workshops* Of meetings) did you atwnd? 
(PteaA checic one response for each time period listed below.) • 



A. BEFORE YOU BEGAN USING THE PROGRArf 
OR MATERIALS IN YOUR CIA5SR00M 



None ■■■■■■■■■■■ 

Eight or fewer hours 
Nine to 24 hours 
25 to 40 hours 
More thin 40 hours 




*B OUtflNGttRST YEAR OF IMPLEMENT VftON ' 
' Noni . . . ■ ^ : : 

.Eight, or fewer hours — =: ^ 

Nine to 24 hours ....... 

25 to 40 hours 

More than 40 hours ^ 



llA. To what extent was the trainnig or assisUnce you received for the use of these rnaterials provided by 
the followtnf IndividuaTs^ {Please circle one response on each line.} ^ * . 



V 

I 



a. A specialist in your district or 
school ^ . . . . 



b. Other -suff me/nbcrs in your 
district'or school 

cj The developer of the 

product 

d. The linking agent, 

e. Other individuals from - 
FLS 

f. Other consuluntsjoutside your 
school district 



NOT AT 
ALL 



0 

0 

0 
•0 

0 

0 



TO SOME 
EXTENT 



1 

V 



. ^jfS A GREAT 
' E^^TENT 

2 . 

.2 

2 

2 

2 

i 

i 

2 



B. Hoy^^useful was the Uainrnfor assistance provided by each? (Please ctrcli^6ne respotjse on 
cach^hne.) » ^ , ' 



NOT AT AIL 
USEFUL 



a. A specialist in your district or 
school ^ . 



b^ Other staff members in your 
. district or school 

c The developer of the 

product 

d. The linking agent 

e* Other individuals frpm 
^ FLS ' 

^f. Other consulunts out^'deyQur ^ 



school district , 



0 
0 
0 



EXXREVELY 
> USEFUL 

7~1~ 



3 

3 

3 
3 

3 



4 
4 

4 

4 



NOT APPLICABir 
DID HOT OCCUR 



N/A 

N/A 

N/A 
N/A 

N/A 

N/A 



ERIC 
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Problem Solving Activfties 

^ — - 

13. A rtujof feature of FLS t$ that It attempts to enpge school sUff in problem jolving activities. In your 
oplmofifdld the following activities take the appropriate aJnount of time? (PJease circle one response for 
each activity listed.) - • > % , 

» ^ i ^ ^ 



a. IdenttfyThg the most 
important pfoblem(s) or 
nccd(s) 

b. Esublishing crfiena for 
selecting a solution 

c. Searching for an R&D ^ 
base'd program* br 

, nvStefw< , . . . . 

d. Selection of an R&D 
based program or 
nfiaterials 

e. Planning for implenoenta- 
tion of the R&D based 
program ^ 



TOO 
SHORT 



ABOUT- 
THE 

TOO RIGHT 
XONG« AMOUNT 



2 
2 



2 

2 



DID not: 

OCCUjl 



N/A 
N/A<, 

N/A 

N/A 

N/A ' 



DJONT KNOW/ 
DONT RECALL 



14. J n the fint year of the FLS project^ what percentpge of panicipatfng teachers would you say were hi4ly 
committed to the problem solving activities in the FLS project? ^ 

• % 



r 



15 ^tfhzi proportion of participating teachen are presently highly commitud to the type of problem ^Ivmg 
actMtjes used in the FLS project? 

• 1 :_% 

16. How would you describe your princi)aJ'$ current attitude, toward the problem solving activit^ used m the 
^FLS project? (Please circle one number.) • 



VERY 
'UNFAVORABLE' 



NEUTRAL 



\ ,VERY 
FAVORABLE 



5 



VI7 Many,pf tf)e problem solving acthriiies within the FLS are supposed to be carrtcd out by a local planmng 
» . team) steering committee or decftioiwnaking group. ThU team or tbmmittce may be based in your school 
or at your district level. 

Are yoi) awart of the acthriiies of this team at your school or school district? (Pleast check one.) 



Yes,;ind I have beei/lnformed of ^nost'of its activities . , 

Yes, buti have only limited information about its activities . • i 

No, I am not jware of iw activities *, 

No such team existed 
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At any time during the past 3 years, hz^you ptrspjtoHy been a member of the local team or committee? 



■Ycj 
No 




If No, ^ip to 
Q. 20 



19. Durins^fikh phases of the program ^^tttt you a team member? O'lea^ check all that apply.) 



While identifying-the problem or need 

Whtle searching for and choosing an'R&D based pro-am or materials 

While making plans for how to best implement the chosen program^or materials 
tn the Khool 

While actually implementing the program or materials / . 



,20. Are you aware of >the rOle of the FIS Headquarters aixf other groups in the FLS? (Please^h^k one.) 
YeSp and I am aware of most of theirwxspon^bilitWand roles . . . . . _. 



Yes, but I have onlyjimttcd ^formation about their roles and responsibilities . • . . . < 

No r 



21. Are you aware of the role of the linking agent In the FLS? (Please check one.) 

• ■ . 

Y^, ^nd l have been informed of most of hisAier jKtivities 

Yes. Alt I have only limited information . 

• No : ■ 





If No, skSp 




10 Q. 25 



22. How much conuct have you ptnohally had With the hnking Agent rurrwd on the cover of the questfonruire! 
(If you have had^onUct with nwre than^ne linking agent, please answer this question and 6u.tstions jZ3 and 24 
for the tndtviduaJ with whom yoa had themosr contact.) 



A lot . . . 
Some . . . 
.Little. 
None . . , 




\ 



.. .. 

I* ■ , 

' • ^ t ♦ . 

• ^ 

23. If .yog have fud 2n> contact with the linking asent« please rate him/her on the folfowing iicnjs. Remcmbcx that no 
tndivitfual can perform alt aspects of his/her role equally well» and please try to disaiminate between hisy her ^ 
performance in the different areas. (Circle one re^nse for each ictrvity or atuibute listed.) , 

• ' J. . " " s 

UNKING AGENT * . * * 

ATTRIBUTES • I DID NOT OONT- 

OR ACTIVITIES* POOR • * EXCELLENT OCCUR RECALL 

a. Ability to explain clearly > - ' . 

' the purposes ancTservices of ' * ' 

theFLS 1 2 3 4 5" N/A , ? 

b. Helpfulr}ess^n specifying, ' ^ ' _ ^ , . ^ 
• analyzing and diagnosing ' ' - 

otrr particular problems or , - . , ^ ' 

needs ^ , -1 T 3 4 .5 _ /N/A ? 

criicfw for se^ec^r^g the . m , , 

solution best suited to ' ^ ^ / 

our needs ' > 2 3^4 5 ' / N/A 

« 

. d. Helpfulness in locating , ... . * / 

alternative solutions ta our ' * ^ * 

problem" v 1 2 3 4. 5 N/A^ ? " 

c/ Helpfulness in finding the * . • ♦ 

best match between our 

problem and a solution. . . 1 2 3 4 5 / N/A ? 

f. /Utility to help us under- j ' , ^ 

stand how the R&D pro- 
gram or materials could ^ 

be used 1 . 2 3 4 /5 N/A ^ ? 

g» Helpfulness in adapting the * , . 

R&D program or materials _ * ; / . ^ 
to our school or school 

drsirict^ 1 ■ 2 3 J ' / S N/A ? 

1). Helpft/tness tn tmplementing y 
the new program or " 

materials * : 1 2 3 / .5 N/A ? 

i. Assisunce in locating 

additional technical resource ' - ' . / 

persons^ 1 2 3 4/ 5 N/A ' 

j. Availability to us when we ^ • * 

* . need to talk to him/her._. . 1 2 3 5 N/A - ? 

\ ^ Jt, Ability to resolve conflicts * - ' . - " ' . 

fairiy t \ 1 2 3.4 5 . N/A ? 

t Skills as an organizer or 

coordinator 1 2 3 4 5 N/A' ? 

m. Assisunce in evaluating our - 
programW . ■ 2 '3 5 N/A J 



o 
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24, bnkinf *^nt$ may vary in ^hc dfgrtt to which they Ukc an active role in assisting a school that is adopting 
an R&D based program or matcfials. Please indicate below the degree to which he/she took initiative in , 
helping to direct the activities of choices of k>cal sUff members in your school. (Please theck one,) 



•r 



Frequently . 

Sometimes ^ . 

Rarely . . ^ 

' Never 

Don't Know/Don't RecaH 



25. Overall, yjttsfted were you with the assistance, services, or support provided by the following individtials 
Of groups in the FLS? (Please circle one response in each line,) 



• 


• 


f. 

NOT 

SATISFIED 




VERY 
SATISFIED 


CANT 
JUDGE/ 
DID NOT 
OCCUR 


DONT 
RECALL 




a. The local school team . . 


1 


2 


3 


4 


5 


N/A " 


7 






1 


2 • 


3 = 


' 4 


5 


N/A 


? 


* 




1 


' 2 


■ 3 


4 


5 


N/A 


? 






^ 1 


r 


3 


4 


5 




? 


• '- 


e. Other organi2atK>ns or 
consultants from outside 
your school or 
district 


t 

.. 1 


2 


3 


4 


• 

5 


N/A 


. ? 



26. To what extent do you fed tt\zXyou personaity have benefited from your schooj's involvement In the FLS 
in the following ways . . . ? (Acase circle one response for each line.) 



a« My teaching, skills have 
improved ......... 



b. My leadershi^skills have 
improved . 



c. Lhave learned about curricu- 
lum development 

* 

d. t have more self* ^ 
' ' confidence „. * * - 



tj, Other 5cKo<)[ personnel rely 

on>me more ' . \ 

1^. 



f. 1*have npw resources for help* 
ing other staff members . . . • 



NOT AJ 
ALL 



0 
0 
0 
0 
0 



TO A 
LITTLE 



EX 



ENT 



TO SOME 
EXTENT 



2 
2 

2 
2 



TO A 
GREAT 
EXTENT 



3 

3 
3 

• 

3 
3 
3 



TO A 
VERY 
GREAT 
EXTENT 



4 
4 
4 
4 
4 
4 



f • 
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TO A 

TO A . TO A VERY 

NOT AT miTLE • TO SOME * * GREAT GREAT 

Kui EXTENT €XT£NT EXTENT EXTENT 

^^M^^^L ^^^^H^^V fc*^^^^^^ 

I tuvc Iwrncd more aboai the ' * 

problem solving process * . * . 0 ' 1 2 ^ 3""^ ^ 4 

h* I have teamed more about U?e ^ — . - # 

/ ^ availability of R&D based pro- ^ ' . ^ 

irams or materials 0 ' 2 3 4 

1. My job is more satisfymt 0 1.2-^-3 4 

i, I have been pven more * ' JJL * ' 

' responsibility or have been ' 
promoted * ; 0 1 . 2 3 4 

■\ ^ 

^ 

We are inter estett in yojr opu,ion v\ the way* which th^ following characteristics or factors changed In your 
xho6iasaftutn ofyourschooVs fmctyement In FLS. (Please circle one on each line.) 

'VERY - " - " " ' VERY 

, MUCH SOMEWHAT . NO CHANGE SOMEWHAT , MUCH 

WO^S^ WO*^^ AT Alt . ' BETTER BETTER 

a. Cuajculuni *1 "2 3 ^ 

b. Available materials 1 2' - 3 ^ 4' 5 

- ^ 

c Teaching methods you use 

in your classroom 1- 2. ^ ^ 

d. The way your classroc^m is ' , ' 

orpnizcd or managed ... 1 i 3 ^ 

^ - ■ • . 

c. The way your school is ' * ' c 
orpnizcd or managed ... V * 2 I ^ ^ \ ^ 

f. Degree of participation of • ■ ^ \ 

teachers in making deci* i , ■ 

sions about this ' , - 

scho<rf 1 2 3 , 4, , • 5 I 

^ f. Frequency of communica- * ^ • • ^ ' 

V . tion among teachers about ^ \ ' 

curriculum^ teaching * ^ ; ' - , ^ { 

techniques and lesson , * ' ^ , ^ , • 

planning 1 2 3 ^ '4 5 

h. MofaJe of the staff, .1 2 *-3-' 4^ - 5 

t. The way specialists are . • * ^ t 

used fn your ichoo! ^ ^ I - . 2. ^3 ^ " jV 4 ^ * ^ 

j. The ways in which prob- . - . \ * '^^l |; ^ 

lems are solved in your • ' V . - *y 

«llPo. * 1 J . / ^ . ;1 - 5 

L The Image of the school in i^f- - * ♦ * . ^ 

the community 1 2 \ • 3 ' 4 ^ 5 , 

' , - 



28. Ovcrair.theFLSirTvoTvedaichocIplannlniuamworklnfwIthanexurfulJin^^^^ . 
« problem solving activities. 

♦ 

A. How different wa tliis approach from previous attempts by your school to solve problems or to adopt 
•new programs or RUterials? (Circle one.) 

NOT VERY 

DIFFERENT PIFFgl^^T 

1 2^3 4 5 

B. Lookinf at the five statements below, please choose theone statement that best describes the extent to 
yAxich your school has used the FLS problem solving approach to deal wtth other school problems. 
(Check one only.) 

We are repeating (or have repeated) the approach to solve at least one . * 

oiner proixem ou* y^t%M ~ - 

We are adopting (or have adopted)-jomeptf/t5 of the approach to ^ 

- * solve another problem at our school - ^ 

We have not used the approach |o solve a'nother problem but wc , 

are planning rfp//n/re/y to use it in the future - ^ 

' We have not used the approach to solve another problem, but we , ^ 

probably will in the future - ^— r, * 

We will definitely not use this approach to solve another problem • , 

in the future ^ ' * ' . 

) . I don't know whether the approach has been used again or whether there are 

plans to use it in the future . * • • 

Z^ThVnkint about the goals of the FLS project at your school, approximately what pcrcenuge of those goals 
^^have been achieved? 

% 

% 

' ^i. '1. . » f 

■■ ^ ... • I 
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School ancj" Personal/Cbaracteristics 



V 



30. In thinking about your school «nd the ways In whkh teachers interact with each dlhtt and parti cipatt in 
" ^5chool dec^ions, please indicate you/ opinion of hoj^ true or false eacfi of the suiements t^elow is in 
^deiaibing^ currfnt situation at your school. (Please circle one ^ofce 9n each line.) 



DEFIMITEty 
FAt,SE <^ 



cMOREOFTCrf MORE OFTEN *^ ' 
FAIJETHAM TRUE THAN OeFlMlTELY ^ 
FAIJE TrUE 



a. Our school is opea ta change or 
innovation T .1 

b. , Teachers call upon each other for 

problems * J , 1 ^ 

c Teachers cooperate with each 
other to achieve comnjon • 
personal and professional^ 
r>4ls J 1 

d. Teachers call on administrators 
for h^lp or advice in solving 
problems ^1 

t* There is tension between i 
teachers and administrators In 
thissch9ol \ 1 

f. Th^e is tensionrbetv^en sroups 
j>i teachers in this school 1 

^ g. The school has a favorable imag^ 

in the community • * . • . . p 1 

, * ^ 

h: The principal of this, school is a 
source of new nuterials, ideas 
and methods 1 

u Our principal spends most of 
*hi>/hef day handlin£,admintstra- 
* tive concerns and discipline^ 
rather than with issues of 
* curriculum and teaching 

methods . . « 1 

j. t have many close friends among 
the suff rpembers in this , 
school ^« . • 1 ' 

k. Recent Innovations ig thi^ s^ool js. , 

have ^Sttn more trouble than 
they are worth *\ 

L Most educational Inn^tions make^ 
the teachers job n)ore » 
rewarding • : I * , . r' ' \ 



TRUE 

y 

2 

2 



2 
2 
2 



/ 



4. 



4 

4 
4 



ERIC 



12 



1 05 



31; Ho^femany years of fuh*tfme teocMng ^perJence have you completed - rwt Including the current year? 
, ' (Enters number In eaA line. Enter "0" where appropriate.) 



Total years of experience 

Total years in 'present schqol 

Total yearslin present school diitrict 



3Z In how many Afferent school systems have you worked? 

p Number of School Systems 



3I Wiut is thc'hf^iest Cuticle civj;te yoa (y"*"^'^ cr.ly.) 

No depxc held currently .| . * / 

Two year cotlefe diploma, defree or certifkate , 

■ Bachelor'^ De^ * ■ 

Mailer's Degree • * • ■ -7 

Education spoctaltst or professional diploma based on 6 years of college study 
Doctor's Degree ^ 



34. What b yobr sex? « ' ' 

Male - - 

• Female 



35* Please Indicate whether or not .you are a member of any of the foWowinf professional onanizations listed 
bdow. (Check one response for each listed.) ^ 

^ \ - ' 'MEMBER NOT A MEMBER 

- * T 

' Natfonat Educatton Association Q ^ O ^ 

American Federation of Teachers D D 

State Education As50ctatk>n 
^ Local Education "Associatkin* ' , J. ^ ^ 

Subject-matter or other professtenal V^t\x\ * * 



\ intere^t^associatk>n 



o 



36. Otlier than meetings of a local education association, how many profmtonil meetlnp did yo« attend In the 
^ ye»r7 (Pleue check, one only.) 

Noner, J. Three.. ' ' 

One * _!-*——'* • Four .... : 

v* Five Of more 



n 



Thank you for your astlmna.\i«aM mail this coptpltud qiMttibnnatn 
In tht tncloMd |>oiUti paM anvtlop* wttfifn ttn ixfi. ^ 
- ■ ■ '-^ '■ : 
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FEOAC NO:S47 

Explfiiion 0«e: Awi, 30, 1980^ 



UNKING R&D WITH SCHOOLS ^ 



X Study of the R&D UtiHzation Program 
Principal Questionnaire, . 
Fall 1979 



Dear Educator: 

Your school has recently been part of^a nation-wide program sponsored by the National ' 
Institute of Education (NIE) called the Research and Development Ut.Uzation 
program.' An •.•nrortatt p^'t tr^'s roz'^-y. was to help it^u.crs and a.mmistrators c.a. 
and solve local problems more effectively. A major feature of the program m m«t schools 
was the involvement of a loca) planning team or steering committee composed f V"chenj 
Tnd administrators. This team frequently worked with an 0"tjjde linking agent'*^^^^^^^ ^ 
Utor to identify a particular problem in basic skills or career education and then to select 
and implement ohe or more research-based programs or materials*** toisolve it. ^ . 

One «oal of the National Institute of Education in supporting the program was w learji 
more Jbou th^ local school improvement process and the rple that externa ly developed 
Zl^TL pUy in making it ^more effective. To this end Abt Ass^.atg Inc a M 
social research firm, was awarded a contract to conduct a study of the RDU program. 

A major source of information for our study is a survey of prlnclpils and a ample of 
teachers at each fchool which has participated in t^e program. We >re asking you to 
complete a questSnnaire this one time, providing information which will ^Pt^bute to a 
bene unde«unding of the needs and successes of schools as they attempt to so ve locally 
def ned problems. It will ukc approximately 30 minutes to compWte this q"«t'0"MJ^', 
S vou mav U^en return directly to us in the enclosed posuge paid envelope. The infor- 
maSn^Sn Ihe^^Se ioveT^of the questionnaire provider further details on the procedures 
we use to protect the confidentiality of all dau we^Jllect, 

Wc Would like to thank you in advance foT your cooperation in helping us to learn about^ 
the^DU program in your school. - ^ ^ * , 



Sincerely, ' 



) 



Karen Seashore Louis, fh.D* 
Project Director 



> You may know the name of the program a» 



' ••According to our Records, the lining agent who worked with your school wa$ 



— •^• ^f f c co f di IndtcatMhat-you^c 




I ' 



iltowini research-baied proyam or materi»l» 



J 



A*;*t \^'^ >f^ ,ppi,*-5 jqqI^i rcsc:'^^ firm, has been enploycd 

xnc National Insututc cf Education lo conduct a Study 'of the R&D 
UtHi2ation Program*. The information that you provide wtlf contribute 
to a better understanding of tiow the problem solvttig process works in 
schools and the rolt tfiat externally developed programs and materials 
can play; ^ ' 

Please be assured th^t your participation in this ^Uidy, is entirely volun* 
tary, Althpug^ we qrge you to complete the questionnaire in the ihtec' 
ests of the study^ your participation or non^artictpation will in no way 
affect your siilndin{or your employment in the school. No member of 
the school district will have a^ss to your responses at any time. To 
protect your anonymity your name does not appear on the question* 
naire. The.number (}n the lower right-hand cdirner of the cover is uved 
to record the receipt of your questionnaire. No information about any * 
individual respondent willi>e identified by her/his n^eor be identtfK^x 
able In any reports published by Abt Associates,|t ^ 

All reports we compile will (Combine ydur answers with those of other 
profe^ional personriifPso as to respect your privacy and the confident!- 
atity of the dau you have given us. You may^ of^^u^se^ omit any 
questions which you consider to be objectionable. Your answer^ to^att 
questions wilt be placed on a computer upe without your name, along 
-W4th^(wen^f4>ther respondents.* __ _ 



Dau being collected under authority of Section 405(b) (2) of the Gen- 
eral Education Provisions Act, af^amended,20 USC 1221e(b) (2). 



0. 



k p|rsonaI Characteristics * 



f 



i: ni»st ifiitiic»t|thc type of jchool tn which you^ wipldyed (Checit one choice only.) 



•ft 



"Primaiy/eiementary school 
Middle school t 



Junior hlj^ school*, 



Senior hi|h schod . ^..^ 

Other (Please 'descHbe) :lj l 



♦ e 



N<tf'emp}($yed {r> Vschool 



2. What U your current job.tiile'i (Check ojjl c*h olce only.^ 



Assls;2nt principal. . . . 
OiheP(Weiic describe). 



I«««B»« B«»^^l 



T 



3. For how nuny yeai have you been in xour current podtionl If thii it your first year ih'thii position, pieas* 
■ -.. 



enter a^;i". 



4, For how many year* have you been employed <?; thiixhooR If this t» your first yey in this Khool, pieajc' 
entera"!". 

- ? Years, 



5. How Jiuny years of ftill-tlmc teachinf cxpcrieiKe - not irKluding thif year - have you completed^ (Pleajc 
cfttef a number for each line,) 

I* 

TotaJ years of experience " 

Total years in present school system . , , * 

Total years in present school 



\ 
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—. . ' ' ' ' - 

6. How many years of administrative experience * noUnclud'mi this year - have you completed? (Please 
enter a r)umber for ^h line,) , ^ 

Total Vl^of ex^rience K . ^. / 

T(^l years in present school system * . , 

Total years in present school • 

*■ » • 
' ^ : ' — 

7^ In how many different school systems have you worked? ' ^ ^ 

Nurpbetof school systems ^ 

8. Please list any professional orfanizations in which you are currently a'member. 

. - - . . / • 

• -c*: . ./ 

: ^ : 7 

'■"^ — ^ r — 

; — = — ' ' ' — : — y 

9. Ourinf the past yeai» what newsletters^ journals or mafazmes discussing educational matters have you 
Ttzd on zfeguTar b^ih * ■ * * , ' v . 

• a. . ^ = 

bj : :_ 

— ■ — ■ ^ — 

d« * i E ] 

— ^ ^ — ^ — 

. * . . . 
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School Characteristics , 

Please answer Questions 10 and 11 either from your record*, or from your fentral knowlMjc. Please enter "0" If 
the answer It nine. It is not necejiary to make a special juivey to obtain this InformatJonJIndlcate how cerOin 
you are of yourins'wer by circlini W of the followinj for eaeh resfionse: / 

, . ^ 1- VERY CERTAIN * t 

" 2 -REASONABLY CERTAIN 
3 -ROUGH ESTIMATE i 

/ 

1 0, Plew describe the f oHowini characterUuc^ of your school's suff : 

& • 

VERY REASONABLY ROUGH 
. . I ' CERTAIN * CERTAIN ESTIMATE 

(CII^CLEONE) . 

a. ^umber of administrative ' ^ " . ^ 

po>Mion> ««••.. • - ' 

b. Number of ichoo»*bascd \ • ^^^V;^ 
specialists #\ 1 2 3' 

c. Number of no*vschoo1 based 

specialists who work tn your >• 

. school periodically, but at * ' _ ■ 

^ least once r month ^. §' " - ^ ^ • ^ 

. • J * ' \ 

d Number of ^ll'time teaching * - . 

positions asjJfned to this * - ^ 
' school ? ^ ^ ^ 

Of the NUMBER OF TEACHERS entered in Quotion lOd, what pefdhit;- * ' , 

e. Are maJe? » .1 ^ 3 

f, Are tcachinx full-time for the ' * . 
first time? \ * ^ - 

J. Are teachlni full-time /rtj^ur • 

scAoo/ for the first time this ^ ' * « . 

ytar? % 1 . ^ 2 - 3 

* 

h- Have been teachiniCll-tlme * • ' • 

for more than 10 years? J 2f 1 ' ^ i - 

l Hold at least a master's * , ^ , 

dejree? » 1 2 3 

I, Are Interested in trylnt out new ^ ■ . . 

tcachlni Ideas? * ' ^ ' "* 

■ * t 

I 

.••• V 

- in • 



\ 



\ 



. s 

11. Hoifr-many PJPILS rXTf current 
enr^U^d in your school? . . . ^ < 



a. ^ KavrlQs rtate/ than 120? . . 

b. Have IQftless than W 

c. Are one or'njorefrxdcs behind 
their gr^de level In-reiding 
achtevement? 



VERY JtEASONABLY ROUGH 
CERTAIN CERTAIN ESTIMATE 



<1. Qualrfyr for^fret or reduced 
cc^t lunches? n , 



• 


« 

# 


tcfcent: 






% 


\' . % 








% 


% 



1 . 
1 

# 

1 



. ICIRC 

\ 



(CIRCLE ONE) 
2 

2 • ■ 
2 

2 

2* 



3 

"3 



•Pfease fstimar^th^PEPCF*^ OF PI'"" «^ - ^otlov-ing groups on the bijis of your present knowledge. 
What "percent: ' . , ' 



e.' Are J^'mcfican tndim or 
\ Alajkan Native? 



% 



* f. Are As'nri or Pacific 
lilanden?' 



% 



f. Arefllspinii 

h. AreBlai;k,notofHi}^ic 
. origipf *^ 1 '\ . 

i. Are ttfifte, not of Hispamc' 
• ongln? 




% 



% 



j...Haj^e a parent who is a college 
'il^ate? ' 

k.vH«(e a jiarent who did not 

• fInithhijJ>KhDol?*. ; 



\'. Hive a parent who i(jtwh<te 
' qolllf.wte^ker? ■■■ ■ iv 

^ m. Come from a fimily which is.' 
npt composed of two 
parents? , 



% 



2 
2 

2 

2 
2 
2 
2 



3 
3 

.3 

3 

3 

3 

3 



42. Hov/ w<kild you describe tfie community in which your school is located? (Please check one cfyrce only.) 

A large city (over 25t),0Qp) \ ' . 

' A suburb near a large cii^ . « • 

A mediUhwized city'(50,6oO 250,000) . . J 

A sfitall city or toMCD (umJer 50,000) not near a large city ' 

Arorji^afea , , 

None of the above 



/ 



Id 
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13. Dufini a typKal jchool year, many decisions nwst b« madeiNof all people Influence any particular decision, and 
the dejree of influence of different person* jenerally wicJjWIth the practices being decided upon. Please indi-, 
<catc, in yogr opinion, the degree oflnfluence vOfi^oMt^pmoM listed below has on the following decisions to 
your-school. (Please Insert the appropriate code number in each box.) , ^ 

0 » USUALLY HAS NO INFLUENCE 
1 » USUALLY HAS MINOR INFLUENCE 
. . . 2 'USUALLY HAS MODERATE INFLUENCE 

^ ' 3 "USUALLY HAS A GREATDEAL OF INFLUENCE 



existing facilities. * 

\ 

I Esublishing salary schedules. 



j. Identifying tfp^ of hoo« wide c[vnj« to be 
implemented. 



L Working oct details f^r impfenientini school 
wtdechj^ges. ^ 



□ 

□ 
□ 



□ 

□ 



1 , * 

DECISIONS 


1UP£RINT£ND£NT 


rftlNCIPALf 


TEACHERS 


a. Selecting texts ana otner maicrtais^ , 


■ 


L_J 




Fct^hlichinff tfi# nht^tiVM for &i£h Cdunit 




; 

□ 




t 

• c 




□ . 


^^^^ 

o. 


r 

6, Adding or dropping courses, ^ 


□ 


□ 




« 

c Hiring of new teachers. 








f. Deciding wheriicf to rcnej« a teacher's conuact- 






□ 


Making specific f^Uy assignments. 


4 

□ 


□ 




h. Planning new factlilics or major changes in use of 


[ZD 


□ 





.□ 
□ 
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R'& D Utilization Project Activities arid Outcomes 

14, A imjor feature of the RDU project is .that It e^igajes school stoff In a series of p/oblem solving activ}t^ Using 
the scale bdow - where 1 represents no Involvement and 5 represenU high Involvement * gleasMKatcate the 
level of your pcTs<Jnal involvement In the problem solving actlvhies listed (Grcle one choice Wkh line,) - 



NO 

iNVOLVeMBhfT 



INVOLVEMENT 



ap/lica^le/ 

U^NOT 
:^URREO 



OONT 
^KNOW 



s.* a. Identifying the most important ' , ' * 

prohicm$($)ornecd(s) * . 1,-2 3 . . 4 5 ^ NA 

b. ^arching^for and chcx>sing ah , ' * 

R&D based program or mat erialj 1 2 3 4 , /S * NA 



c. Making plans for how to best 
implement Xxm^.cwuJKcku 
based program or materials 

d. Actually implementing the 
program or use of materials and 
monitoring its effectiveness 



1. 



NA 



NA 



~ ^ 

15. The problem solving activities associated with the RDU project, such asthose described in Question 14, are 

usually carried ou^ by a local planning team, steering commtttet or decision nukjng group composed of teachers 

and admintsiratofs. This team may be baied in y^r Khoot or at the ^strict leveL 

Does (or did) such a team, group or committee exist in your Khool or district? 



/ 



Yes 

No 

Don't Know. . 





If No or 




Don't Know, 
skip to Q. 17 



a. ff /£S,at any time during the past tfiree .years, have yoo personally been a member of the loca! team, 
groups or committee? ^ * , 



Yes 
No. 



16. Overall, how would you describe your attitude toward the kind of problem idving acttvtties that the team in 



your school or dbtria enpged In? 



V£RY 

UNFAVORABLE 



FAVOlW^ 
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/ ■ ■ *• 

17. Aipirt of-youf jchoon Involvement in the ROU proinni you mjy hjve had conuct with a number of jource* 
of MMUnce in suijport of your effortj. Overall; how ufiifttd were you with the UMtzna, amcti or support 
* . provided by the following IndividualJ or groupj in the program? (Circle onc'on-cach line.) 

ID . 

OONT ' * 

m 

? 





NOT 
; SATISFIED 




VERY 
SATISFIED 


DtD 
NOT 
OCCUR 


m m 

i. The local school team. 


1 • 


2" 


3. 


-r 4 


5 


NA 


b. The linking agent 


1 


2 


3 


4 


i5 


NA 


c. The ROU project »uff 
(exduding the linker) 


1 


2 




4* 


5 


NA 


d. Developers of R&O base^ 
programs or materials. 


1 


2 


3 


4 


5 

* 


NA 


c Other organizations or con- 















school or district 



NA 



/ 18. How much conuttLve you personally had with the linking agent? (If you had conuct with more thap one 
. linking agent, please art«irer/tfi« (fuejtion and questions 19 and 20 for theindtvidual with whom you had the 
most contact) (Check oni^ 



Some 
Utile 
None 



If None, 
(kfp to 0. 20 



19 If you had any corhact with Jhe Imkinj aient P'w« \\m!t\ti on the followinf lt«ms. Remember ^at no 
' individual can perform all ajpccu of hn/her role equally well, and please try to discriminate betwctn his/her pcr- 
fomunct ifl different areas. (Orcle one on each line.) 



POOR 



EXCELLENT 



CANT 
JUDGE/ 
DID NOT 
OCCUR 



CANT 
RECALL 



^ Ability to explain dearly th^ pur- 
poses ind seryices of the ROU 
program* 

b. Helpfulness in specifying ana- 

• lyiiht and diagnosini our partic- 
ular problems or needs. 

c. Helpfulness in developing ^ ^ 
criteria for selecting the solu* '"^ 
Uon best suited to our nced^ 

d. Hdpfulness in locating aJterna- . 
. tjve solutions to our problems. 

e. Helpfulness in finding the best 
match between our problem and 
a solution. ^ 

f. Ability to help osunderstand 
how the R& 0 based program 
or mater^ should be used 



2^3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 -5 

2 3- 4 5 

2 3 4 5 



NA 

NA 

NA 
NA 

NA 

r 

NA 
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p Heipfufness m^dapting the 
' R&D product to our schooler. 
^ school district 

h. Helpfulness in implementing the 
new i^opam or nuterials. 

L Assistance in 4ocat!ng2ddiUonal' 
* technical resource persons. 

Availibiitty to us when we need 
to talk to him/her. 

k* Ability to resolve confl^^ts fairly* 

I Skitlsasanbrpnizer or 
coordinator* 

« 

RV. Assistance in evaluating our 



/ 



program* 



i 

•1 
1 



2 
2 
2 

« 

2 
2 

2 

2 



EXCELLENT 



3 
3 
3 

3 
3 
3 



4. *. 5 



4 

4 

4 
4 



5 
5 

5 

5 



CANT 

JUQJSE/ 
DID NOT ) 
OCCUR 



NA 



NA 

NA 

NA. 
NA 

NA 

NA 



CANT 
RECALL 



r • 



20. the linkint afents may vary in the degreftto whKh they uke an active role in auistint a school that is adopt 
ing an RAD bawd program or materiait. neat indicate b{lo>» tht degree to which he/ihe took initiative in 



hdptni to direct the activities or choices of local staff members in your school. (Check one.) 



/ 



frequently •,*••/• 

Sometimes . . /. 

Rarely .... 

Never 

Don't Know 



21* Has your Khool or district setecttd an R&D based program or miunals as a result oj participation In the RDU 

— prajram? (Check one.) • \ — ^ 

i 



Yes 

No, we are still in the process of identifyint the problem*. 

No, we have identified the problftnf but have not yet finished searchin| for t)<e best 
solution \A 

Mo^ we have searched for a solution but the producu have looked at don't seem^ 
to meet our^needs ?. 

Don't know 



If 
No or 
Don't 
Know, 
tJdp 

to 
Q. 28 



ZL Are naff members in you( school presiet^tly using 0te R&O based profranl or nuterfals? (Check one.) 



V 



o 
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-TLu ] to Q.^i 



EBJC , 



. ' ^ ' V • ^ , • ^ • 

23. The foUowini quwtions ask yoy to rtpoct on the type«f (pdlvidiAli and poups that may be affected by 
the R&D based program or matcrjaJs that your ^hoot bimplmenitn|. Ptcaje |jvc your best estimate for 
• tach of the following ^ ^ * \ ^ " ^ ' . 

The PERCENTAGE of; . * 

a. Odirooms in your school in wtllch the product Is tJ>cd' * ?i 

b. Pupils in your school with whom the product is used directly 2L , 

c. Ttochm assigned to your school who ustf^e product SS- 

' d Specla/lsts based in your school who tisc the product t 21 

e, Howlnany schools in your disuict, in addition to your own school, arc tjsing the 

prop-am or materials? - • : * ^ * 

Amonig those who are using the program or materials in your schoo[: ^ , * ^ 

f, What Is the approximate number of hours and fractions thereof (in minutes) in a typical teacher's 
week that are affected by use of the program or materials, , ♦ 

HOURS _L_MINUTES 

g, ttXit :*ic a&>«0)5imate in,r;ibcr\)f hours and minutes in a.typical pupil's wee^-that are affected by . 
the use of the program or maurials, ^ ^ ^ ; 

' HOURS MINUTE? 

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 

Plctsc give 111 y<H/r cpjnfon on rarh nf rhf fftllowing characteristics of the R&D based program or materials 
^ by circling the most appropriau response. (Grcle one on each line,) ^ 

TO A * ' 

NOT TO A TO A* VERY NOT 

AT LITTLE TO SOME GREAT GREAT AfPLI- DONT 

ALL EXTENT EXTENT EXTENT EXTENT CABLE, KNOW 

To what extent x.. . % ^ 

a. Has pupil achievement 

Improved as a result of the use " a ' ma 7 ^ 

of the pWgram Of materials? 0 12.^ 4 NA . ^ 

b. Have pupil attitude^of rL^ 0 , 
bchavioryimproved as a result ^ ^ ^ ' 
of theusCof theprbgram Of ' ^ , , ' * 
materials? . 0 1 2 3. 4 NA^ ? . ^ 

c. Has H been difficultiolmple- 

. ^eni the program Of m^aterials? 0 1 2 3 4 NA f 

d. Has implementttion of the ' * _ 
program or materials helped - * ma ■ » 
solve die identified problem? 0 1 2 3 4 *NA ?• , 

e. WoulS it have been too cx^jen- ' ' * \ ' ' 
^ sivetoadoptthepragramor 1 » 

maurialswltfioutcxunul. ^ I ^s** * 1 

funds? . ' . ^ -0, 1 2 3 /4 riA ? . 

Will continued use of the pro* ■ \ ^ 

gram or maurials be of - _ I ' 

rcasonablecost to your school • ? " * 

bddget? 0' 1 V 2^ ^ f , ? 

• . ' . • ^ ' £17 "J • - ^ 



TS^tiit indicate v^ether any of the following steps have already betn taken or are planned to ensur/ that the 
R&D based program or material^ adopted by your school will be continued (Please circle ope In each row.) 



a. The program or materials have 
been formally incorporated into 
curriculum plans. 

b. We have developed written 
'guidelines for theiise of the 
materials and methods from 

the program. * 

c. New staff will receive training or- 
orientation in the use of the R&D 
Droram mate ''';^U or methods 

d. We will continue to have training 
programs or inservice for current 
staff members to maintain the ^ 
use of the progranr, materials or 
methods. 



' WILL 

NOT 
OCCUR 



MAY 
OCCUR 



f WILL 
DEFINITELY 
OCCUR IN 
' THE NEAR 
FUTURE 

r 



3 V 



ALREADY 
OCCURRED 



e. We have purchased new materials 
and supplies in order to majn- 
tain our use of the program or 
materials. 

f. Because of the use of the prO' 
gram or materials written job 
descriptions for some staff mem-' 
bers have been changed. 

g. We have hired new suff member^ 
specifically ta support the use of 
the R&D program or materials. ; 

h. Our budget now includgi a 
separate line item to suffpori the. 
use of the R&D program or 
materials. * 



3 , 



. 1 
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* 26. Over the next few yean, which of th* following possibilities do you think is most ffkeiy to happen wi«h 

respect to the use of the R&D base(^^materlals or methods among teachers U this Khool? (Pleas? check the. 
most appropriate response.) * ^ 

The materials or methods will be dropped , . 

Some or all of the teachers will u;e the materials or bethods, but they will not be used 

extensively , . . V. . . ? — ^— 

Some or all of the teachers will uie the materjals or methods and they will generally be 

used quite extensively - • — 

t 

• V. " 

r ^ . ' ''lis 



I ■ ■ ' ■ V . 

27 iht RDU appfoKh b biKd on the utc of RAD bwcd programs or miterials a$ a means of solving local 
■ school problems, O^nslderinf what you have leaned about R4D based programs or materials durirtg your 
school's Involvemetit with the program, please Indicate how Hktly It Is that you wHI try to^jse these In the 
future: (Please check the most appropriate response.) 

We would turn to some RAD based programs or materials first, and consMer adopting 

other types of prograjps or matertaJs as a last resort — ^— 

We would probably try to find R4D based prograpis or materiaJs first, but would aJso . 

look for other possible solutions either locaJly or within the sUte ^ — i^^ 

We would try to find some R4D based programs or materials to fiview, but would not feel 

any preference for an RAD based solution over a locally developed program or materials. . . 

^e wo^ld be unlikely to make a search fdr ^4D based programs or materiaJs in future 
efforts to improve our program - • " 

■■ • — — ' — ^ '■ — : 

28- OviraJt, the RDU Project involved a school planning team working with a linking agent on a series of ^ 

problem solving actrvitics, , 

/ ( 
Hc^w different ^as VrM appiv^ch iiuin previous »ntmpu to solve problems ^ tp adopt new programs or 
materials In your school? (Circle one.) 

NOT 

. VERY VERY 
^DIFFERENT • DifFfRENT 

.1-2 3 4 5 . 

29. Uoking at the five statements below, please choose the one sutement that bqt describes the extent to which 
your school has used the RDU approach to probler^ solving in dealing i^th other school problems. (Check one , 
choice only.) 

■ 

We are repeating (or have repeated) the RDU approach to solve anpther problem in ^ 

our school ^ ^ , * • ^ 

We are adopUng (orTfiaVe adopted) some parts of the RDU approach, to solve another 

problem-in our school ' — ^— 

^ We have not used the RDU approach to solve another problem, but we probably will in 

the future ' — 

We have not used the RDU approach to solve another problem but we are planning 

definitely to use it in the future . .> 

We vwll definitely not use this approach to solve another problem In the future . - . ^ 

I don't know whether the RDU approach has been used apin'or whether there are plans 

to use it In the future . * ^ 
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36s How llkdy fs it that your school will use the following aspects of the RDU approach to problem solving to 
aftdress future needs that may arise? (Circle one on each line.) 



NOT USE 



a^ The ust of a tcifti or committee 
t , of teachers and administrators. 

b. The use <sT3te servib^s of an 
* ^xternaMinketv 

c. The approach tothc process of 
identifvi'ngandimpro^g.in ^ 
this school. 

d. The ap'proach lo identifying 
possible solutions to our 
problems. 

e Tbf apcroach to mak'"^ i dec?- 
sion among alr^'^iuvc solutions^ 
to a problem, 

f. The approach to planning for 
implemenution, 
r g. The approach to implementation 
and feedback. 



TROBABtt 

NOT Use 


PgOBABLY 
USE 


DEFINrTELV 
USE 


DID NOT 
rERCEIVE A 
DtSTINCTIVt ' 

ArrROACH 


2 




t 

4 


. NA 


2 . ' 




4 


NA 






4 


NA 


2 


. . 3 


4 


NA 


2 ^ 


3 


4 


NA 


2 


3 


4 


NA • 


^ 2 




4 . 


NA / 



31. We are inif rested in your opinion of the ways in which the following characteristics or factors changed In your 
school or ichool^stncts as a result of your school's Invohfefflenl in the RDU program. (Circle one on each 
Jinc.') ^ , . 



TYfC OF CHANCE 

a« Curriculum' 
b^Tcaching methods 
^ c. Available materials ^ 

d. The way the school is organized , 

e. Partictpatlon of teachers in 
making decisions about this 
school or school district 

f. Frequency of communication 
anfong teachers about cuj^ic* 
ulum, teaching techniques and , 
lesson planning 

' %, Ktorale of the 5t4ff 

^ h* The way specialists are used in 

your school. 

5. The ways 1ft which problems arc ■ 
solved in the scho6l \ 

j. The Image of the school ift<h^ 
community 



VERY 


SOME- 




^ME- 


VERY 


p 


MUCH 


WHAT 


NO CHANGE 


WHAT 


MUCH 




WORSE 


WORSE 


AT ALL 


BETTER 


JETTER 




1 


2 


3 ■ 


4 


5 


1 


/ 2 


3 




, 5 




1 


2 


' 3 


4 


5 • 




1 


2 

• 


♦ 3 


4 


5 

* 




1 


2 


3 


4 


5 ■ 


i 


• 

1 


2 


3 V 


■ ' '4 


5 




1 


2 




4 


5 




1 


2 


3 


4 




9 






■ 


■ 


1 




ft 

1 


2 


3 


4 








• 










1 


2 


3 


4 


5 





3Z Thinking about the goajs of the RDU program at your school, what percenttgrof those goalt have been 
acffleved? » ^ 
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Xost of Parttcipatiorf in RDU Program 



33.rln the foWowtni Table, we ask for information that will en^bie us to determine the personnel <fosU to schools par- 
J tkipatini in the RDU Pro|ram. We are l;itere$ted both In total personnel cost* and In costs incurred durinf each 

state of the RDU procesr. 1) problem identification. 2) solution selection, a/id 3) solution implemenUtion, It is 
Important to emphasize that we are Interested in your best tstlmotes or cpproximations. 

Your completed table mt^t look like this: - ^ 

STACIS 



f 

L STAFF 
TYft 


It NUMIUOF 
* ' EACH TYf I 


III 


AVUACC ANf^UAL 
SALAI^Y 


1 

* IV^f ItOlLtH 
rPtNTlflCATtON 


V. SOLUTION 
StLtCTlON 


1 

Vt SOLUTION 
'lUrUUtNTATION * 




# (i) 






Q> 




Oct A , -Dec* 
u^Wto uonth 


Pec- Feb. 

UONTN TO HOKTH 


March June 

»fONTN TO U0Np4 

w S 


> 


• 


* - 


# 






TOTALyOMIWOFf^ 


TOT«V'W^*'«>tOT 
ftAtS 


TOTAL flUMltfc OF 

DAYS ' 






3 ■ 


s 


12,000 




7.5 ' . 


*\ 15 


22.5 




Admlnlttrater 


2 


s 


19,000 




6 ' 


( 6 ' 


17 




Sr^cclalUt 






14,000 










k 




\ 

V 


1. 
















y ' 


1 






« 


• 


\ 





NOTES. L ListtfieJyptfJof JcAoo/jrc// members participating in any sugeof the RDUprocess, 
^ by jVb title. . 

1 Enter the nymi^er of school suff rnembers \n tuch staff type. 

\\ 

^ 3. Estinute the^ra^fl/wiwi/jfl^^fjwch suff tv;«,Cpg., enter II 2,000 as the average 

annual salary for the teacher suff type if three teachers have arfnual salaries of $1 1 ,000, 
$12,000, and $13,000, respectively. ^ - ' 

/n. Enter ^h^month in which each suge began and the month in which it ended. 

^ • 5, Estimate the total numbtr of days {^ day ■« hours) spent by each staff type during 

each of the stages, e.g*, enter 7.5 person days under problem identification if three 
teachers spent 2.5 days each on tJ^at suge. ^ * ^ 
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\\\, AVERAGE ANNUAL IV*^ PROBLEM V. SOLUttON , 

^ SALARY IDErfTlFtCATIOl^ SELECTION 



MONTH Tff MONTH MONTH TO MONTH 



TOTAL NUMBER OF' TOTAL NUMBER OF 
. DAYS , DAYS ^ 



1 



Thank you for your wslsU^ncc Please mail this corpptetcd queijlonnaire 
)n the ertcloied posUte'pald envelope within t*^ (days. v 



422- 
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APPEfJDIX E 



Vpr Products Adopted by Schools in Six R^El Projects* 



• *Data on adoptions were unavailable from the National Education 
Association ROU project. * * , . 
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Table 6 

Product Adoptions fo^Each RDU Project, by Spr'ing^ 1979 



r 




• 


PROjfcT 




w 






NAME OF ftlOOUCt . 


Florida* . 


Penru 


NRC 


Kich, 


Georgia 


NETWORK 


|nea» 


CAREER EDUCATION . 

• 










^ 






Crisp Co, (Go.) & Orange Co, 
(Fla,) Career Education* 

Basic Skills Through Practical Arts 

f 






« 




1 


< 

t 


« 


Georg4i^ Career Guidance , * ' 
It Works 

Locally Developed Career * 
Education Handbook* v 




■ 
t 

J 




« 


6 






Orange Co. (Fla.) Career Educatian . 






; 


* • 


• * 






Free To Be You and, He • , 


V 






Z 








Careers: A 'Supplemental * 
Reading Program , - ^ 


\ 


t 


* 




( 


*• 




innercriange 








2 • 


y. ■ 






Project* HEAR (1) * 

« 


1 










* 


/ ' Livelihoods 
• 














• 


m » 

Hy Bread dnd Butterflies 
Career Book 

■ « 


• 


« 


r 


> Wm 
1^ 
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Table 6 (continued) 



^ t 

* 




PROJECT 






* • 




NAHE OF"" PRb6l)CT • 

« . « 


Florida 


Penn. 




■Hj ch. 


Georgia 


- NETWORK 

4 
«■ 


NLA 


CAREER'.EDUCATION ^continued)/ 
















Caieer Awareness lxplo?&t ion 
vCurriculum Kit V . 

Freestyle \ * * ' 1 

Career Development Centere4 ^ " / 
Curriculun'^d) ^ ^ / 

* " < * ^ ' y 


» 


ii 


« 

r 

• 


i 
r 

7 
/ 


/ 


■c 

\ 

• 


• 


Getting It Together < 








1 




i 




The Jo& Ahead 

. * • - ■ 


■ 






1 








The Magtc Circle " ' % 








2 




* 




Einpioyability Ski^Us. 

AEU Experience-Based Career 
* Education Program (1) 


• 

1 




- 


1 




• 




*AEL ^ Career Decisionmaking 
'iprp^rsm • 








o 








^ * ^ f 
' First Jo^ff^ ^•'J/^'^ " 








3 








Health: 'Decision^SiDf Growth 








1 


• 






Career Explor&tion in the - 
Eart,h Science^ (2) 








1 


• 


• 

• 




f ■ i ■ • 

Michigan ACT Career Planning 
Piogi;4n ^ 


• 

• 


• 




. 1 

• 


* 




f 
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Table* 6 (continued) 

If 


• 


■ 




i 

/ 


— J — 


« 




PROJECT ■ 






/ 

^ / 




NAME OF PRODUCT 


Florida 


Pepn. 


NRC 


■Mich. _ 


Georgia 
• 


NETHORl/ 

/ 

/ 


NEA 


•■AftECR EDUCATION (conlinued) 






m 






* 


« 


« 

Wnrkina With Trees (2) *^ 
















Introtfuction to Cowmunily ' • 

Ppn^prQ 

« 








1 




/ * 




' Career Opportunities Boxes 








2 




f 




• aust Me (2) ' 

Career Development for 
Childrey , * 


0 

4 




• 


1 

1 




• 


■ / 


Exploring Tareera 
Valuing Approach toTareer 

^ PVfiif*nf ion 


• 






1 

2 

* 


• 




1 

r 

« 

• 


nnnfv Cops to Work ^ 


1 


• 




1 








K^aroo Kil , • 

" • - 

Career Awareness K-6 . «<: 
• 

Doso Kits (American 

Hi 1 i H nripp An nnt* ^ J * 


* 




• 


1 

1 
2 


/ 


• 

• 


1 


" He and Others 

• 


« 

• 

• * 


k 


• 


2 . 


A* 

/ 




• • 



o 
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^sble 6 tcontinued) 



im. or PRODUCT 



rEaoing" 



-7 



Continuous Progress 
Reading . 

English/Reading Rotation 
Program^ (I) 

project PAL (1) 

Secondary Reading' Leb 

I^idividual Language Arts (1) 

Manlies Pro|ram, NY State 
Coordinated English- S 
Language Arts * ^ 

SMART (1) 

Sacajawea Plan (thru 
Precision Teaching and SOR^! 

Perception Plus (1) 
SDR (1) 

Basic Spelling '* 

Wiscronsin Design for 
Reading (2) 

Project HARC 




X 



Open Court 



Toil 



Exeinplary Center 

ryction-- 



i^qY^ leading InAtryc 



PR03EC1 



'riorida 



2 
it 
1 



Penn. 



2 
2 

1 

2 



NRC 



Mich. 



Georgia 



•v. NETWORK 



NEA 



/ . 



' <4^* ' Table 6 (continued) - * 



< 


• 

» 




PROaECT. 




ft 














\ 


f 


■"iWHE OF PRODUCT 




Florida 

■ 


Penn. 


NRC 


Hicti. 

b_ 


Georgia 


NETViORK 


N£A 




READING (continued) . ^ 














• 






larnell Loft Skills 




1 

• 




• 










r 


^ SRA-'SchoolhoOse Comprehension 


Y- 


■ ^ 1. 




1 
1 

J 

y 

1 

1 

1 

¥k f 


r 

IT 


* 




Ik 


* 


FOCUS—Reading Curriculum* (1) 


« 








* 




* 




Laubach Tutoring program* 


' t 
















JtSnior Great fooks* 

Content Reading Inservice 
Package* * 

CommunicaljLon Skills Fmprovement • 
• Center (1) - ^ 


1 




•s 


« 


> 

- 

- 


/ 

^ 


1 


i 

i 


Intensive Reading Improvement 
Center (1) • 

'Dallas Basic Skills* 


1 
• 


r 




1' 


















1 


• * 




.. . ■ ^ 






Nampa Communication Skills* 


<i 


> 




ft 






V 






Hiscellaneous Products 
developed txy the sites* 

San Diego R2R . r 


ff 


li 

■f 

• 


* 


8 
2 

• 


f 


- 


5 




• 


• * 
Pegasus-PACE ID 








■* 


■ 










Classroom Intervention 

Project (1) 

J - ' 

• 


4 - 
i 


■ * 




# 






* 3 
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Table 6 (continued) 



READING (continued) 



• NAME or PRODUCT 



Systematic Approach to 
Reading lRiprov€faent^-SARI 

Houghton-Hifflin Basal 
Management System* 

Spellscnpt* 

Parents Assist Beginning 
Reading Management 
SySjv^ra* 

SHRL^Ginn Communication 
Skills Program 

Sustained Siient Reading* 

Reading Resource Center* 

Development of a Language 
Arts Scope/Sequence* ^ 

^ngleman-Becker Reading , 
and Horphographic 
Spelling* 

Columbia F^iver, Developmental 
Reading Program 

I • 
'^Bay Area Writing Program* 

Holt Series and Management 
System* 
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PR03ECT 



riorida 



Penn. 



•i. 



NRC 



Mic-h. 



Georgia 



NETWORK 



N£A 



J35 



Table 6 (continued) 



PR03ECT ^ 



Florida 



* « 



1. 
1 



Penn. 



NRC 



1 



Mich. 



Geotiaia 



NETWORK 



NEA 



IP? 



. # 

Table 6 (concluded) 



1 ^ 




- PROJECT 








NAME OF PRODUCT 

• • 


Florida 


Penn. 


- NRC- 

* 

• 


Hich. 


Georgia 


NETWORK 




MATHEMATICS (continued) 












• 




Brevard County LAMP 

* f 


■ 

3 








• 






Hath Learning Systewa ^ 


1 






> 








SRA-^Hathematics Involvement j 


1 




r 




• * 




• 


SRA— Haatery Test 


1 








• 






MISCELLANEOUS 
















. Evaluation Worl^shop from the 
Center for the Study of 
Evaluation* f2) 

SPECS— School Planning, , . 
Evaluation, & ronvRunications 
System* (2) 


\ 


- 






1 

« 

^ 1 


• 


• 

1 


Wehauken Plan* 






• 


• 


. 1 


• 




Positive Attitude Towards 
Learning— PATL (J) 


• 


2 ■ 










• 

> • 
• 


Individually Guided Educat-ion (2) 












* • 





KEY ■ . • . 

* The NEA project did not keep a list of the products that Were adoptefl by the sites. 

» Product not in knowledge base 

(1) Product listed in the NDN catalog ' ^ 

<2) Product listed in the NIE catalog . ' ' ^ 
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APPENDIX F 

Criteria for Judging the Quality of Problem Solving 




• 




WEMORANOdM 



TOi ' ROU Staff * * • ». 

FROM: Diane KelJ • " 

RE: An ".Ideal" Problera-Solving Hodel (Revised) 

DATE: -10/24/79 



This meoorandun sets forth the criteria for judging the extent to 
ich the pnoblem-solving activitxes of the ROU schools were, congruent with 
und problem solving and group decision making practices. * 

The criterla^Vor sound tprobl em solving (Part X below) are different 
for each stage, while the .criteria for soind grqup decision making (Parf; 2 
bel(^) are the same for each stage. 



The criteria ray be gi\en unequal weights. Some criteria may be 
more important for some ^tes than others, or may have been more out- 
rageously disregarded in some sites. To decide upon a rating, think of 
each criterion as a possible debit. In general, a site should be given 
a "4" rating only if it has no debits , and a ["1" rating only if it has 
four or more debits . These, however, are only rough guidelines, and you 
may use your own Judgement. 



Part It Problem Solving 



Problem hfentification 

a. Problem spec^cations^-i.e. , searching for concrete problem indicators, 
analyzing perceived causes, and assessing specific needs— precedes 
search, selection, and implementation of a solution. * - 

b. Alternative definitipns of the problem are posed and considered. 

c. Any special procedures that are adopted, (e.g. ,'NnBeds assessment survf^^ 
writing of problem statemepts, discrepancy. analysis) are carried out 
fullx and appropriately. '*/ ' ' 

d. ^/ldequatfe evidence of the ^»oblem is obtained (though/in some cases, 
K ' this may not* require extensive dobunentation or new data collection 

and analysis)^ • - 

e. The level of effort devoted to problem identification is appropriate 

to the circunstances. ' ' • • » - 

/ . 

f. Definition df problem is acceptable to" a siAstantial majority of 
those affected by the decision). " * , ^ t 

g. Definition of problem is clear, manageable, and relevant to the situa- 
. tion: it is neither too narrgw (trivial) ngr too broad (grandiose). 

h. Definition of probletd-is newAi^e. , not a restatement of a priori 

«, assunptioos aboul^eeds or th^ pet theory of a particular clique or 
individual. 



Solution Selection ^ 


a« ^Problem is referred to an agent/agency for search of solutions (this 
- may include, but should nojr be restricted to, members of the problem- 
solving group) . \' , 

J 

b« Conduct of search is objective, responsive to the problem statement, ^ 
technically competent (i*e*, "professional"), and thorough. , . X,^ 

c# Clarifipation of problem is^ obtained when necegsary* 

d* Delivery of alternative solutions is expeditious (within reasonable 
or expected time period)* - ^ 



ERJ.C , 



Evaluation evioence or^)ther criteria* of effectiveness or suitability 
are given 'to the school • ^ . ^ * / 

* ' * ' / 

f . Selection process beings maialy after delivery of alternative solutions / 
from the appropriate agent/agencT^ If locally familiar solutions are | 
contemplated while the formal search process (as described above) is j 
taking place, the final selection is postponed until the formal search • ^ 
process is completed and all alternatives^ are'delive^ed,- 

g. Alternatives are carefully examined; they merits and demerits are ^ 
assessed according^ to explicit criteria • \ 

h* Additional information abmlt solutions is sought (e*g*, through site | 
visits, cdnsultation, etcJ or additional searches are ordered, when ' i 

questions arise about the outcomes of the original search • 

1* The level of effort devoted to selectior^ is appropriate to the circum- 
stances* 

j. Solution. IS acceptable to a substantial majority of those effected 
by the decision* 

k* 'Solution i& new^ i*e*,^ not a practice or product that has already been 
implemented in the target school* 

1* Solution IS manageable, , acceptable to administration or other external 

parties, and cost-effective* / ^ 

m. Solution is relevant to original problem statement, likely to have the' 
intended effect on't students or staff, and in dther respects high in 
quality* ' , * 
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Planning for Impleqentation < 

Con^rainl^s that will affect implement a tiop are realistically assessed. 
Administtative support and cooperation ari^gained for implemeritation. 
Formal plans are drawn* up to ^govern: • 

1. leadership and staffing 'of implementation team ^ % 

2. field trials ' - _ ' ^ ^ ' 

3. resource needs /money, materials, equipment) 

4. scheduling of treatment 

5* distribution of treatment among students/schoolVstaf f . 

6. training or staff development ' ^ 

7. feedback or evaluation 

8. public relations with nonparticipating staff and community. 

External linkers/consul tants/agencies are exploited as necessary. 

Measures are taken to ensure^ thatjihe chosen product/program relains 
its essential features and. goals ilT the course of implementation. 

Adaptations pf the product/progranr made prior to implementation are 
appropriate, judged according to whether the adaptation responded to; ▼ 

1. * obvious defecfin product/program ' ^ 

2. genuine local needs of student or staff 

3. inalterable constraints in the situation 

4. special opportunities or leverages in the situation 
^ that all6w for enhancement of the product/program's 

effect _ ' , 

The level of effort devoted to planning for implementation is appropriate^ 
io the situation. - ' ' * \ 




Implenentation 

/ a. All elements of the ifliplementation plan are borne_in mind and reali-zed 
in some fom. - — 

b. Th* actual scope of implefflehtation (nwnber or proportion students 
'^or staffs frequency of use) is about right or greater than in^ded. 

c. Difficulties in lipleinentBtion are realisitically assessed .and ef forts 
are made to resolve them. 

^ P - ^ 

d. Administrative support and cooperation are gained or reinforced. 

e. External linker s/consultants/agpncies' are •exploited as necessary. 

f. Measures are taken to ensure that the chosen product/program retains 
its ^ss^tial features and goals in the course of implementation. 

0. Adaptations of the product/program made after implementation are ^ 
appropriSe, judged according to the stanaardc-listed ea-^\er (under 
Planning^or implementation) . " , 
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Fart 2; Group Decision Making 

The criteria for ludainq group decisjuon making practices are^ the same 
at 6ach stage^ Thrae criteria are: 

. * * \ 

a. A forroally constituted group'^ is established or empowered to cnake the 
, ' decisions related tc/that^stage. 

b. Meetings are held regularly (at least once a mortth).^ 

c. Attendance at meetings^i^good, and level of interest seems high. 

xi. .Compositioa of group represents those who -will fee directly affected 
by decisions, ^ ^ 

e. Collection deliberation takes place, and deto ocratig ^djfglon making 
is engaged^in. \ 

* " * t . 

f. Conflict IS* managed well» and any terterons within the group are dealt 

with openly and efforts made to resolve them. ^ 
□ • Leadership is accepted afjd appropriate. 

h. Decisions are not subverted or diptated by adroinistrafiDn or other 
external party t^-e.^' the group h§3-both legitiroatjy and poV(er to roake 
decisions that are binding on local project) e 

1. Progress is made from one meeting to the next (i.e., the sape issues 
are noX recurrently addressed without evidence of progress loHard 
their* resol<jt ion) . • . - ~ 

For dir.stages^subsequent to the fitst stage, tliere is an additional, 
criterion: ^ , * . 

j. Ther£ is sufficient continuyity in the membership of the group to 
ensure that it profits ftom the knowlei^ge and experience of its 
T^members and to ensure that it is faithful to decrsions made at 
eaVlier stages. / 



